Aug 13 09:15:35 devstack cinder-volume[83420]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 13 09:15:35 devstack cinder-volume[83420]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 13 09:15:35 devstack cinder-volume[83420]: we strongly recommend against using it for new projects. Aug 13 09:15:35 devstack cinder-volume[83420]: If you are already using Eventlet, we recommend migrating to a different Aug 13 09:15:35 devstack cinder-volume[83420]: framework. For more detail see Aug 13 09:15:35 devstack cinder-volume[83420]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 13 09:15:35 devstack cinder-volume[83420]: import eventlet # noqa Aug 13 09:15:38 devstack cinder-volume[83420]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83420) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 13 09:15:38 devstack cinder-volume[83420]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83420) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 13 09:15:38 devstack cinder-volume[83420]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83420) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 13 09:15:39 devstack cinder-volume[83420]: INFO dbcounter [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Registered counter for database cinder Aug 13 09:15:39 devstack cinder-volume[83420]: DEBUG oslo_db.sqlalchemy.engines [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83420) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 13 09:15:40 devstack cinder-volume[83420]: DEBUG dbcounter [-] [83420] Writer thread running {{(pid=83420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 13 09:15:40 devstack cinder-volume[83420]: INFO cinder.rpc [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 13 09:15:40 devstack cinder-volume[83420]: INFO cinder.rpc [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 13 09:15:40 devstack cinder-volume[83420]: DEBUG oslo_db.sqlalchemy.engines [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83420) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 13 09:15:40 devstack cinder-volume[83420]: INFO cinder.volume.manager [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Determined volume DB was empty at startup. Aug 13 09:15:40 devstack cinder-volume[83420]: DEBUG cinder.volume.manager [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83420) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 13 09:15:40 devstack cinder-volume[83420]: INFO cinder.volume.manager [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 13 09:15:40 devstack cinder-volume[83420]: WARNING stevedore.named [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 13 09:15:40 devstack cinder-volume[83420]: WARNING castellan.key_manager [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 13 09:15:40 devstack cinder-volume[83420]: WARNING cinder.keymgr.conf_key_mgr [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 13 09:15:40 devstack cinder-volume[83420]: DEBUG cinder.volume.drivers.lvm [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=83420) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 13 09:15:40 devstack cinder-volume[83420]: DEBUG oslo_concurrency.processutils [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=83420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:40 devstack cinder-volume[83420]: DEBUG oslo_concurrency.processutils [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] CMD "cinder-rtstool verify" returned: 0 in 0.513s {{(pid=83420) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:40 devstack cinder-volume[83420]: DEBUG oslo_db.sqlalchemy.engines [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83420) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 13 09:15:40 devstack cinder-volume[83420]: INFO cinder.rpc [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 13 09:15:40 devstack cinder-volume[83420]: INFO cinder.rpc [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 13 09:15:40 devstack cinder-volume[83420]: WARNING stevedore.named [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 13 09:15:40 devstack cinder-volume[83420]: WARNING castellan.key_manager [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 13 09:15:40 devstack cinder-volume[83420]: INFO cinder.volume.manager [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 13 09:15:40 devstack cinder-volume[83420]: DEBUG oslo_db.sqlalchemy.engines [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83420) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 13 09:15:40 devstack cinder-volume[83420]: INFO oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Starting 1 workers Aug 13 09:15:40 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Started child 83649 {{(pid=83420) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 13 09:15:40 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Full set of CONF: {{(pid=83420) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 13 09:15:40 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] ******************************************************************************** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 13 09:15:40 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Configuration options gathered from: {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] ================================================================================ {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] allow_availability_zone_fallback = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] allow_compression_on_image_upload = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] allowed_direct_url_schemes = [] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] api_rate_limit = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] auth_strategy = keystone {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] az_cache_duration = 3600 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_availability_zone = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_host = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_name = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_stats_polling_interval = 60 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backup_api_class = cinder.backup.api.API {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83649]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backup_name_template = backup-%s {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backup_use_same_host = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backup_use_temp_snapshot = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] chap_password = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] chap_username = {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cinder_internal_tenant_project_id = dbd88289500d46d0966a01fb0dd72db7 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cinder_internal_tenant_user_id = 6db85268742a40769839318f215da7de {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cloned_volume_same_az = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cluster = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] compression_format = gzip {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] compute_api_class = cinder.compute.nova.API {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] config_dir = [] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] config_source = [] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] control_exchange = openstack {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] debug = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] default_availability_zone = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] default_group_type = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] default_volume_type = lvmdriver-1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] disk_geometry = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] driver_client_cert = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] driver_client_cert_key = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] driver_data_namespace = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] driver_ssl_cert_path = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] driver_ssl_cert_verify = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] driver_use_ssl = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] enable_force_upload = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] enable_new_services = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] enable_unsupported_driver = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] enabled_backends = ['lvmdriver-1'] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] enforce_multipath_for_image_xfer = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] filter_function = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance_api_insecure = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance_api_servers = ['http://192.168.122.97/image'] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance_api_ssl_compression = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance_ca_certificates_file = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance_catalog_info = image:glance:publicURL {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance_certfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance_keyfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance_num_retries = 3 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance_request_timeout = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] goodness_function = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] graceful_shutdown_timeout = 5 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] group_api_class = cinder.group.api.API {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] host = devstack {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] image_compress_on_upload = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] image_conversion_address_space_limit = 1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] image_conversion_cpu_limit = 60 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] image_conversion_disable = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] image_upload_use_cinder_backend = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] image_upload_use_internal_tenant = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] image_volume_cache_enabled = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] image_volume_cache_max_count = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] image_volume_cache_max_size_gb = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] init_host_max_objects_retrieval = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] instance_format = [instance: %(uuid)s] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] iscsi_target_flags = {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] iscsi_write_cache = on {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] iser_helper = tgtadm {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] iser_ip_address = 192.168.122.97 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] iser_port = 3260 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] log_color = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] log_config_append = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] log_dir = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] log_file = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] log_options = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] log_rotate_interval = 1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] log_rotate_interval_type = days {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] log_rotation_type = none {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] max_age = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] max_logfile_count = 30 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] max_logfile_size_mb = 200 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] max_over_subscription_ratio = 20.0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] message_reap_interval = 86400 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] message_ttl = 2592000 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] migration_create_volume_timeout_secs = 300 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] monkey_patch = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] monkey_patch_modules = [] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] my_ip = 192.168.122.97 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] no_snapshot_gb_quota = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] num_iser_scan_tries = 3 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] num_shell_tries = 3 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] num_volume_device_scan_tries = 3 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] nvmeof_conn_info_version = 1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] nvmet_ns_id = 10 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] nvmet_port_id = 1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] osapi_max_limit = 1000 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] osapi_volume_ext_list = [] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] osapi_volume_listen = 0.0.0.0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] osapi_volume_listen_port = 8776 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] osapi_volume_use_ssl = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] osapi_volume_workers = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] per_volume_size_limit = -1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] periodic_fuzzy_delay = 60 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] periodic_interval = 60 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] project_id_regex = [0-9a-f\-]+ {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] public_endpoint = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] publish_errors = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] quota_backup_gigabytes = 1000 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] quota_backups = 10 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] quota_gigabytes = 1000 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] quota_groups = 10 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] quota_snapshots = 10 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] quota_volumes = 10 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] rate_limit_burst = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] rate_limit_except_level = CRITICAL {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83649]: INFO cinder.volume.manager [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] rate_limit_interval = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] reinit_driver_count = 3 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] replication_device = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] report_discard_supported = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] report_interval = 120 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] reservation_clean_interval = 86400 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] reservation_expire = 86400 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] reserved_image_namespaces = [] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] reserved_percentage = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] rpc_response_timeout = 120 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] run_external_periodic_tasks = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] scst_target_driver = iscsi {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] scst_target_iqn_name = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] service_down_time = 720 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] shell_completion = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] snapshot_name_template = snapshot-%s {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] snapshot_same_host = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] split_loggers = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] state_path = /opt/stack/data/cinder {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] storage_availability_zone = nova {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] storage_protocol = iSCSI {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] syslog_log_facility = LOG_USER {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] target_helper = lioadm {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] target_ip_address = 192.168.122.97 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] target_port = 3260 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] target_protocol = iscsi {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] target_secondary_ip_addresses = [] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] trace_flags = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] transfer_api_class = cinder.transfer.api.API {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] transport_url = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] until_refresh = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] use_chap_auth = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] use_default_quota_class = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] use_journal = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] use_json = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] use_multipath_for_image_xfer = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] use_stderr = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] use_syslog = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] verify_glance_signatures = enabled {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] volume_api_class = cinder.volume.api.API {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] volume_backend_name = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] volume_clear = zero {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] volume_clear_ionice = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] volume_clear_size = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] volume_copy_bps_limit = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] volume_dd_blocksize = 1M {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] volume_name_template = volume-%s {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] volume_service_inithost_offload = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] volume_usage_audit_period = month {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] zoning_mode = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_concurrency.disable_process_locking = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.auth_section = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.auth_type = password {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.auth_version = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.cache = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.certfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.delay_auth_decision = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.http_connect_timeout = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.include_service_catalog = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.insecure = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.interface = public {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.keyfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_password = {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcache_username = {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.region_name = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.service_token_roles_required = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.service_type = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.token_cache_time = 300 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.97/identity {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.backend = dogpile.cache.null {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.backend_argument = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.backend_expiration_time = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.config_prefix = cache.oslo {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.debug_cache_backend = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.enable_retry_client = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.enable_socket_keepalive = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.enabled = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.expiration_time = 600 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.hashclient_retry_attempts = 2 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.memcache_dead_retry = 300 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.memcache_pool_maxsize = 10 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.memcache_sasl_enabled = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.password = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.proxies = [] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.redis_db = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.redis_sentinel_service_name = mymaster {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.redis_server = localhost:6379 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.retry_attempts = 2 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.retry_delay = 0.0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.socket_keepalive_count = 1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.socket_keepalive_idle = 1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.socket_keepalive_interval = 1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.socket_timeout = 1.0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.tls_allowed_ciphers = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.tls_cafile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.tls_certfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.tls_enabled = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.tls_keyfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cache.username = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] coordination.backend_url = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.asyncio_connection = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:41 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.asyncio_slave_connection = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.backend = sqlalchemy {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.connection = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.connection_debug = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.connection_parameters = {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.connection_recycle_time = 3600 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.connection_trace = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.db_inc_retry_interval = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.db_max_retries = 20 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.db_max_retry_interval = 10 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.db_retry_interval = 1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.max_overflow = 50 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.max_pool_size = 5 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.max_retries = 10 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.mysql_wsrep_sync_wait = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.pool_timeout = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.retry_interval = 10 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.slave_connection = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.sqlite_synchronous = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.synchronous_reader = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] database.use_db_reconnect = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] profiler.connection_string = messaging:// {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] profiler.enabled = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] profiler.es_doc_type = notification {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] profiler.es_scroll_size = 10000 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] profiler.es_scroll_time = 2m {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] profiler.filter_error_trace = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] profiler.hmac_keys = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] profiler.sentinel_service_name = mymaster {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] profiler.socket_timeout = 0.1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] profiler.trace_requests = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] profiler.trace_sqlalchemy = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] profiler_jaeger.process_tags = {} {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] profiler_jaeger.service_name_prefix = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] profiler_otlp.service_name_prefix = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_policy.enforce_new_defaults = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_policy.policy_default_rule = default {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_policy.policy_file = policy.yaml {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_policy.remote_timeout = 60.0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] privsep_osbrick.group = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] privsep_osbrick.helper_command = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] privsep_osbrick.user = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cinder_sys_admin.group = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cinder_sys_admin.helper_command = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] cinder_sys_admin.user = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] service_user.auth_section = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] service_user.auth_type = password {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] service_user.cafile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] service_user.certfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] service_user.collect_timing = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] service_user.insecure = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] service_user.keyfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] service_user.send_service_user_token = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] service_user.split_loggers = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] service_user.timeout = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance.auth_section = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance.auth_type = password {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance.certfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance.collect_timing = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance.insecure = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance.keyfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance.region_name = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance.split_loggers = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] glance.timeout = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.backend_availability_zone = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.chap_password = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.chap_username = {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.disk_geometry = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.driver_client_cert = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack sudo[83728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 13 09:15:41 devstack sudo[83728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.driver_client_cert_key = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.driver_data_namespace = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.driver_use_ssl = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.enable_unsupported_driver = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.extra_capabilities = {} {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.filter_function = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.goodness_function = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.iscsi_target_flags = {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.iscsi_write_cache = on {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.iser_helper = tgtadm {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.iser_ip_address = 192.168.122.97 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.iser_port = 3260 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.lvm_mirrors = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.lvm_share_target = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.lvm_type = auto {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.num_shell_tries = 3 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.nvmet_port_id = 1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.replication_device = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.report_discard_supported = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.reserved_percentage = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.scst_target_driver = iscsi {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.scst_target_iqn_name = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.storage_protocol = iSCSI {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.target_helper = tgtadm {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.target_ip_address = 192.168.122.97 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.target_port = 3260 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.target_protocol = iscsi {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.trace_flags = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.unique_fqdn_network = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.use_chap_auth = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.volume_backend_name = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.volume_clear = zero {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.volume_clear_ionice = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.volume_clear_size = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.volume_group = cinder-volumes {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_reports.file_event_handler = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_reports.log_dir = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.backend_availability_zone = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.backend_host = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.chap_password = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.chap_username = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.chiscsi_conf = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.disk_geometry = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.driver_client_cert = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.driver_client_cert_key = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.driver_data_namespace = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.driver_use_ssl = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.extra_capabilities = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.filter_function = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.goodness_function = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.iscsi_target_flags = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.iscsi_write_cache = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.iser_helper = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.iser_ip_address = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.iser_port = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.iser_target_prefix = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.lvm_conf_file = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.lvm_mirrors = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.lvm_share_target = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.lvm_type = auto {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.num_shell_tries = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.nvmet_ns_id = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.nvmet_port_id = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.replication_device = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.report_discard_supported = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.reserved_percentage = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.scst_target_driver = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.storage_protocol = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.target_helper = lioadm {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.target_ip_address = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.target_port = 3260 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.target_protocol = iscsi {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.trace_flags = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.unique_fqdn_network = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.use_chap_auth = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.volume_clear = zero {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.volume_clear_ionice = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.volume_clear_size = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] lvmdriver-1.volumes_dir = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.ssl = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.ssl_version = {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_notifications.driver = [] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_notifications.retry = -1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] oslo_messaging_notifications.transport_url = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] key_manager.fixed_key = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.barbican_api_version = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.barbican_endpoint = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.barbican_endpoint_type = public {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.barbican_region_name = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.cafile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.certfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.collect_timing = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.insecure = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.keyfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.number_of_retries = 60 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.retry_delay = 1 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.send_service_user_token = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.split_loggers = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.timeout = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.verify_ssl = True {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican.verify_ssl_path = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican_service_user.auth_section = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican_service_user.auth_type = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican_service_user.cafile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican_service_user.certfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican_service_user.collect_timing = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican_service_user.insecure = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican_service_user.keyfile = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican_service_user.split_loggers = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] barbican_service_user.timeout = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vault.approle_role_id = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vault.approle_secret_id = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vault.auth_method = approle {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vault.auth_path = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vault.kv_mountpoint = secret {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vault.kv_path = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vault.kv_version = 2 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vault.namespace = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vault.root_token_id = **** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vault.ssl_ca_crt_file = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vault.timeout = 60.0 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vault.token_file = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vault.token_role = None {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vault.use_ssl = False {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:15:41 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] ******************************************************************************** {{(pid=83420) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 13 09:15:41 devstack sudo[83728]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:41 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:41 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:41 devstack sudo[83800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 13 09:15:41 devstack sudo[83800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:41 devstack sudo[83800]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:41 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.256s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:41 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:15:41 devstack cinder-volume[83649]: INFO cinder.brick.local_dev.lvm [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 13 09:15:41 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:41 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:41 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:41 devstack sudo[83901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 13 09:15:41 devstack sudo[83901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:42 devstack sudo[83901]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:42 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:42 devstack cinder-volume[83649]: DEBUG cinder.brick.local_dev.lvm [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83649) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 13 09:15:42 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:42 devstack sudo[83989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 13 09:15:42 devstack sudo[83989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:43 devstack sudo[83989]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:43 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.066s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:43 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:43 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:43 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:43 devstack sudo[84257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 13 09:15:43 devstack sudo[84257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:43 devstack sudo[84257]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:43 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:43 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:43 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:43 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:43 devstack sudo[84261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 13 09:15:43 devstack sudo[84261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:43 devstack sudo[84261]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:43 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.315s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:43 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:43 devstack sudo[84303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 13 09:15:43 devstack sudo[84303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:44 devstack sudo[84303]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:44 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:44 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:44 devstack sudo[84353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 13 09:15:44 devstack sudo[84353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:44 devstack sudo[84353]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:44 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:44 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:44 devstack sudo[84356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 13 09:15:44 devstack sudo[84356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:44 devstack sudo[84356]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:44 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:44 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:44 devstack sudo[84359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 13 09:15:44 devstack sudo[84359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:44 devstack sudo[84359]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:44 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:44 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:44 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:44 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:44 devstack sudo[84363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 13 09:15:44 devstack sudo[84363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:45 devstack sudo[84363]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:45 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:45 devstack cinder-volume[83649]: INFO cinder.volume.drivers.lvm [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 13 09:15:45 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:45 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:45 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:45 devstack sudo[84367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 13 09:15:45 devstack sudo[84367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:45 devstack sudo[84367]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:45 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:45 devstack cinder-volume[83649]: DEBUG cinder.volume.drivers.lvm [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Updating volume stats {{(pid=83649) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 13 09:15:45 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:45 devstack sudo[84376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 13 09:15:45 devstack sudo[84376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:45 devstack sudo[84376]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:45 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:45 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:45 devstack sudo[84379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 13 09:15:45 devstack sudo[84379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:45 devstack sudo[84379]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:45 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:45 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:45 devstack sudo[84383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 13 09:15:45 devstack sudo[84383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:46 devstack sudo[84383]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:46 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:46 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:46 devstack sudo[84388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 13 09:15:46 devstack sudo[84388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:46 devstack sudo[84388]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:46 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:46 devstack cinder-volume[83649]: INFO cinder.volume.driver [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Driver hasn't implemented _init_vendor_properties() Aug 13 09:15:46 devstack cinder-volume[83649]: DEBUG cinder.volume.driver [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83649) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 13 09:15:46 devstack cinder-volume[83649]: DEBUG oslo_db.sqlalchemy.engines [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83649) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 13 09:15:46 devstack cinder-volume[83649]: DEBUG dbcounter [-] [83649] Writer thread running {{(pid=83649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 13 09:15:46 devstack cinder-volume[83649]: DEBUG cinder.db.api [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Building query based on filter {{(pid=83649) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 13 09:15:46 devstack cinder-volume[83649]: DEBUG cinder.image.image_utils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83649) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 13 09:15:46 devstack cinder-volume[83649]: INFO cinder.keymgr.migration [None req-a075fff2-5c97-4007-9bec-3dc99db270e9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 13 09:15:46 devstack cinder-volume[83649]: DEBUG cinder.volume.drivers.lvm [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Updating volume stats {{(pid=83649) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 13 09:15:46 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:46 devstack sudo[84391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 13 09:15:46 devstack sudo[84391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:46 devstack sudo[84391]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:46 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:46 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:46 devstack sudo[84396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 13 09:15:46 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:47 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:47 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:47 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:47 devstack sudo[84399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 13 09:15:47 devstack sudo[84399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:47 devstack sudo[84399]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:47 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:47 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:47 devstack sudo[84402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 13 09:15:47 devstack sudo[84402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:47 devstack sudo[84402]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:47 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:47 devstack cinder-volume[83649]: DEBUG cinder.manager [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Notifying Schedulers of capabilities ... {{(pid=83649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:15:47 devstack cinder-volume[83649]: INFO cinder.volume.manager [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Driver initialization completed successfully. Aug 13 09:15:47 devstack cinder-volume[83649]: INFO cinder.manager [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Initiating service 2 cleanup Aug 13 09:15:47 devstack cinder-volume[83649]: INFO cinder.manager [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Service 2 cleanup completed. Aug 13 09:15:47 devstack cinder-volume[83649]: DEBUG cinder.service [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Creating RPC server for service cinder-volume {{(pid=83649) start /opt/stack/cinder/cinder/service.py:231}} Aug 13 09:15:47 devstack cinder-volume[83649]: DEBUG cinder.service [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83649) start /opt/stack/cinder/cinder/service.py:237}} Aug 13 09:15:47 devstack cinder-volume[83649]: INFO cinder.volume.manager [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 13 09:15:47 devstack cinder-volume[83649]: DEBUG cinder.volume.drivers.lvm [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Updating volume stats {{(pid=83649) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 13 09:15:47 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:47 devstack sudo[84406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 13 09:15:47 devstack sudo[84406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:48 devstack sudo[84406]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:48 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:48 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:48 devstack sudo[84409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 13 09:15:48 devstack sudo[84409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:48 devstack sudo[84409]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:48 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:48 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:48 devstack sudo[84418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 13 09:15:48 devstack sudo[84418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:48 devstack sudo[84418]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:48 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.352s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:48 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:15:48 devstack sudo[84425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 13 09:15:48 devstack sudo[84425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:15:49 devstack sudo[84425]: pam_unix(sudo:session): session closed for user root Aug 13 09:15:49 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.380s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:15:49 devstack cinder-volume[83649]: INFO cinder.volume.manager [None req-96f890cc-dd6c-475f-8166-2d401d42f838 None None] Driver post RPC initialization completed successfully. Aug 13 09:15:50 devstack cinder-volume[83420]: DEBUG dbcounter [-] [83420] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83420) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:15:59 devstack cinder-volume[83649]: DEBUG dbcounter [-] [83649] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:15:59 devstack cinder-volume[83649]: DEBUG dbcounter [-] [83649] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=83649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:16:03 devstack cinder-volume[83649]: DEBUG oslo_service.periodic_task [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running periodic task VolumeManager._thread_info {{(pid=83649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:16:03 devstack cinder-volume[83649]: DEBUG cinder.volume.manager [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] thread count: 6 {{(pid=83649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:16:03 devstack cinder-volume[83649]: DEBUG cinder.volume.manager [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] thread info: [<_MainThread(MainThread, started 127461842133120)>, , , , , ] {{(pid=83649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:17:03 devstack cinder-volume[83649]: DEBUG oslo_service.periodic_task [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:17:03 devstack cinder-volume[83649]: DEBUG cinder.volume.drivers.lvm [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Updating volume stats {{(pid=83649) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 13 09:17:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:17:03 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 13 09:17:03 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:17:03 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Aug 13 09:17:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:17:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:17:03 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 13 09:17:03 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:17:03 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Aug 13 09:17:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:17:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:17:03 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 13 09:17:03 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:17:04 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Aug 13 09:17:04 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:17:04 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:17:04 devstack sudo[86784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 13 09:17:04 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:17:04 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root Aug 13 09:17:04 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:17:04 devstack cinder-volume[83649]: DEBUG cinder.manager [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Notifying Schedulers of capabilities ... {{(pid=83649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:17:04 devstack cinder-volume[83649]: DEBUG oslo_service.periodic_task [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running periodic task VolumeManager._thread_info {{(pid=83649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:17:04 devstack cinder-volume[83649]: DEBUG cinder.volume.manager [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] thread count: 6 {{(pid=83649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:17:04 devstack cinder-volume[83649]: DEBUG cinder.volume.manager [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] thread info: [<_MainThread(MainThread, started 127461842133120)>, , , , , ] {{(pid=83649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:17:59 devstack cinder-volume[83649]: DEBUG dbcounter [-] [83649] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:18:03 devstack cinder-volume[83649]: DEBUG oslo_service.periodic_task [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:18:03 devstack cinder-volume[83649]: DEBUG cinder.volume.drivers.lvm [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Updating volume stats {{(pid=83649) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 13 09:18:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:18:03 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 13 09:18:03 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:18:03 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Aug 13 09:18:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:18:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:18:03 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 13 09:18:03 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:18:03 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Aug 13 09:18:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:18:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:18:03 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 13 09:18:03 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:18:04 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Aug 13 09:18:04 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:18:04 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:18:04 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 13 09:18:04 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:18:04 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Aug 13 09:18:04 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:18:04 devstack cinder-volume[83649]: DEBUG cinder.manager [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Notifying Schedulers of capabilities ... {{(pid=83649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:19:03 devstack cinder-volume[83649]: DEBUG oslo_service.periodic_task [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:19:03 devstack cinder-volume[83649]: DEBUG cinder.volume.drivers.lvm [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Updating volume stats {{(pid=83649) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 13 09:19:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:19:03 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 13 09:19:03 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:19:03 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Aug 13 09:19:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:19:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:19:03 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 13 09:19:03 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:19:03 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Aug 13 09:19:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:19:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:19:03 devstack sudo[92104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 13 09:19:03 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:19:04 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root Aug 13 09:19:04 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:19:04 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:19:04 devstack sudo[92129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 13 09:19:04 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:19:04 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root Aug 13 09:19:04 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:19:04 devstack cinder-volume[83649]: DEBUG cinder.manager [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Notifying Schedulers of capabilities ... {{(pid=83649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:19:04 devstack cinder-volume[83649]: DEBUG oslo_service.periodic_task [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running periodic task VolumeManager._thread_info {{(pid=83649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:19:04 devstack cinder-volume[83649]: DEBUG cinder.volume.manager [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] thread count: 6 {{(pid=83649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:19:04 devstack cinder-volume[83649]: DEBUG cinder.volume.manager [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] thread info: [<_MainThread(MainThread, started 127461842133120)>, , , , , ] {{(pid=83649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:19:59 devstack cinder-volume[83649]: DEBUG dbcounter [-] [83649] Writing DB stats cinder:SELECT=1 {{(pid=83649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:19:59 devstack cinder-volume[83649]: DEBUG dbcounter [-] [83649] Writing DB stats cinder:UPDATE=1 {{(pid=83649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:20:03 devstack cinder-volume[83649]: DEBUG oslo_service.periodic_task [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:20:03 devstack cinder-volume[83649]: DEBUG cinder.volume.drivers.lvm [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Updating volume stats {{(pid=83649) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 13 09:20:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:20:03 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 13 09:20:03 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:20:03 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Aug 13 09:20:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:20:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:20:03 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 13 09:20:03 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:20:03 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Aug 13 09:20:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:20:03 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:20:03 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 13 09:20:03 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:20:04 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Aug 13 09:20:04 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:20:04 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:20:04 devstack sudo[93314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 13 09:20:04 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:20:04 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root Aug 13 09:20:04 devstack cinder-volume[83649]: DEBUG oslo_concurrency.processutils [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=83649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:20:04 devstack cinder-volume[83649]: DEBUG cinder.manager [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Notifying Schedulers of capabilities ... {{(pid=83649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:20:04 devstack cinder-volume[83649]: DEBUG oslo_service.periodic_task [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] Running periodic task VolumeManager._thread_info {{(pid=83649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:20:04 devstack cinder-volume[83649]: DEBUG cinder.volume.manager [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] thread count: 6 {{(pid=83649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:20:04 devstack cinder-volume[83649]: DEBUG cinder.volume.manager [None req-6bb1f00f-eba3-48ef-a127-2ebc3a27dd1d None None] thread info: [<_MainThread(MainThread, started 127461842133120)>, , , , , ] {{(pid=83649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:20:14 devstack cinder-volume[83420]: INFO oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Caught SIGTERM, stopping children Aug 13 09:20:14 devstack cinder-volume[83420]: DEBUG oslo_concurrency.lockutils [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Acquiring lock "singleton_lock" {{(pid=83420) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 13 09:20:14 devstack cinder-volume[83420]: DEBUG oslo_concurrency.lockutils [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Acquired lock "singleton_lock" {{(pid=83420) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 13 09:20:14 devstack cinder-volume[83420]: DEBUG oslo_concurrency.lockutils [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Releasing lock "singleton_lock" {{(pid=83420) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 13 09:20:14 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Stop services. {{(pid=83420) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 13 09:20:14 devstack cinder-volume[83420]: DEBUG oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Killing children. {{(pid=83420) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 13 09:20:14 devstack cinder-volume[83420]: INFO oslo_service.backend._eventlet.service [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Waiting on 1 children to exit Aug 13 09:20:19 devstack cinder-volume[83649]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Aug 13 09:20:19 devstack cinder-volume[93697]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 13 09:20:19 devstack cinder-volume[93697]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 13 09:20:19 devstack cinder-volume[93697]: we strongly recommend against using it for new projects. Aug 13 09:20:19 devstack cinder-volume[93697]: If you are already using Eventlet, we recommend migrating to a different Aug 13 09:20:19 devstack cinder-volume[93697]: framework. For more detail see Aug 13 09:20:19 devstack cinder-volume[93697]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 13 09:20:19 devstack cinder-volume[93697]: import eventlet # noqa Aug 13 09:20:21 devstack cinder-volume[93697]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 13 09:20:21 devstack cinder-volume[93697]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 13 09:20:21 devstack cinder-volume[93697]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 13 09:20:22 devstack cinder-volume[93697]: INFO dbcounter [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Registered counter for database cinder Aug 13 09:20:22 devstack cinder-volume[93697]: DEBUG oslo_db.sqlalchemy.engines [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93697) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 13 09:20:22 devstack cinder-volume[93697]: DEBUG dbcounter [-] [93697] Writer thread running {{(pid=93697) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 13 09:20:22 devstack cinder-volume[93697]: INFO cinder.rpc [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 13 09:20:22 devstack cinder-volume[93697]: INFO cinder.rpc [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 13 09:20:22 devstack cinder-volume[93697]: DEBUG oslo_db.sqlalchemy.engines [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93697) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 13 09:20:22 devstack cinder-volume[93697]: INFO cinder.volume.manager [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Determined volume DB was empty at startup. Aug 13 09:20:22 devstack cinder-volume[93697]: DEBUG cinder.volume.manager [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93697) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 13 09:20:22 devstack cinder-volume[93697]: INFO cinder.volume.manager [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 13 09:20:22 devstack cinder-volume[93697]: WARNING stevedore.named [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 13 09:20:22 devstack cinder-volume[93697]: WARNING castellan.key_manager [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 13 09:20:22 devstack cinder-volume[93697]: WARNING cinder.keymgr.conf_key_mgr [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 13 09:20:22 devstack cinder-volume[83649]: DEBUG oslo_concurrency.lockutils [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Acquiring lock "singleton_lock" {{(pid=83649) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 13 09:20:22 devstack cinder-volume[83649]: DEBUG oslo_concurrency.lockutils [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Acquired lock "singleton_lock" {{(pid=83649) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 13 09:20:22 devstack cinder-volume[83649]: DEBUG oslo_concurrency.lockutils [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Releasing lock "singleton_lock" {{(pid=83649) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 13 09:20:22 devstack cinder-volume[83649]: WARNING amqp [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 13 09:20:22 devstack cinder-volume[93697]: INFO cinder.volume.manager [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 13 09:20:22 devstack cinder-volume[83649]: WARNING amqp [None req-d6982da6-d02b-415d-84d7-1f527a1b07ec None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 13 09:20:22 devstack cinder-volume[93697]: DEBUG oslo_db.sqlalchemy.engines [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93697) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 13 09:20:23 devstack cinder-volume[93697]: INFO oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Starting 1 workers Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Started child 93919 {{(pid=93697) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Full set of CONF: {{(pid=93697) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] ******************************************************************************** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Configuration options gathered from: {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] ================================================================================ {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] allow_availability_zone_fallback = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] allow_compression_on_image_upload = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] allowed_direct_url_schemes = [] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] api_rate_limit = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] auth_strategy = keystone {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_availability_zone = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_host = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_name = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_stats_polling_interval = 60 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backup_api_class = cinder.backup.api.API {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backup_name_template = backup-%s {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backup_use_same_host = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backup_use_temp_snapshot = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93919]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] chap_password = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] chap_username = {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cinder_internal_tenant_project_id = dbd88289500d46d0966a01fb0dd72db7 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cinder_internal_tenant_user_id = 6db85268742a40769839318f215da7de {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cluster = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] compression_format = gzip {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] compute_api_class = cinder.compute.nova.API {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] config_dir = [] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] config_source = [] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] control_exchange = openstack {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] debug = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] default_availability_zone = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] default_group_type = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] default_volume_type = QuobyteHD {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] disk_geometry = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] driver_client_cert = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] driver_client_cert_key = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] driver_data_namespace = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] driver_ssl_cert_path = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] driver_ssl_cert_verify = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] driver_use_ssl = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] enable_new_services = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] enable_unsupported_driver = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] enabled_backends = ['QuobyteHD'] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] enforce_multipath_for_image_xfer = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] filter_function = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance_api_insecure = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance_api_servers = ['http://192.168.122.97/image'] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance_api_ssl_compression = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance_ca_certificates_file = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance_catalog_info = image:glance:publicURL {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance_certfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance_keyfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance_num_retries = 3 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance_request_timeout = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] goodness_function = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] graceful_shutdown_timeout = 5 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] group_api_class = cinder.group.api.API {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] host = devstack {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] image_compress_on_upload = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] image_conversion_address_space_limit = 1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] image_conversion_cpu_limit = 60 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] image_conversion_disable = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] image_upload_use_cinder_backend = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] image_upload_use_internal_tenant = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] image_volume_cache_enabled = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] image_volume_cache_max_count = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] image_volume_cache_max_size_gb = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] init_host_max_objects_retrieval = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] instance_format = [instance: %(uuid)s] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] iscsi_target_flags = {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] iscsi_write_cache = on {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] iser_helper = tgtadm {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] iser_ip_address = 192.168.122.97 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] iser_port = 3260 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] log_color = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] log_config_append = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] log_dir = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] log_file = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] log_options = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] log_rotate_interval = 1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] log_rotate_interval_type = days {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] log_rotation_type = none {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] max_age = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] max_logfile_count = 30 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] max_logfile_size_mb = 200 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] max_over_subscription_ratio = 20.0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] message_reap_interval = 86400 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] message_ttl = 2592000 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] migration_create_volume_timeout_secs = 300 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] monkey_patch = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] monkey_patch_modules = [] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] my_ip = 192.168.122.97 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] no_snapshot_gb_quota = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] num_iser_scan_tries = 3 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] num_shell_tries = 3 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] num_volume_device_scan_tries = 3 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] nvmeof_conn_info_version = 1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] nvmet_ns_id = 10 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] nvmet_port_id = 1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] osapi_max_limit = 1000 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] osapi_volume_ext_list = [] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] osapi_volume_listen = 0.0.0.0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] osapi_volume_listen_port = 8776 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] osapi_volume_use_ssl = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] osapi_volume_workers = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] per_volume_size_limit = -1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] periodic_fuzzy_delay = 60 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] periodic_interval = 60 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] project_id_regex = [0-9a-f\-]+ {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] public_endpoint = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] publish_errors = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] quota_backup_gigabytes = 1000 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] quota_backups = 10 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] quota_gigabytes = 1000 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] quota_groups = 10 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] quota_snapshots = 10 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] quota_volumes = 10 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] rate_limit_burst = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] rate_limit_except_level = CRITICAL {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] rate_limit_interval = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] reinit_driver_count = 3 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] replication_device = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] report_discard_supported = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] report_interval = 120 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] reservation_clean_interval = 86400 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] reservation_expire = 86400 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] reserved_image_namespaces = [] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] reserved_percentage = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] rpc_response_timeout = 120 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] run_external_periodic_tasks = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] scst_target_driver = iscsi {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] scst_target_iqn_name = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] service_down_time = 720 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] shell_completion = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] snapshot_name_template = snapshot-%s {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] split_loggers = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] state_path = /opt/stack/data/cinder {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] storage_availability_zone = nova {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] storage_protocol = iSCSI {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] syslog_log_facility = LOG_USER {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] target_helper = lioadm {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] target_ip_address = 192.168.122.97 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] target_port = 3260 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] target_protocol = iscsi {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] target_secondary_ip_addresses = [] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] trace_flags = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] transfer_api_class = cinder.transfer.api.API {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] transport_url = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] until_refresh = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] use_chap_auth = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] use_default_quota_class = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] use_journal = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] use_json = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] use_multipath_for_image_xfer = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] use_stderr = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] use_syslog = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] verify_glance_signatures = enabled {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] volume_api_class = cinder.volume.api.API {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] volume_backend_name = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] volume_clear = zero {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] volume_clear_ionice = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] volume_clear_size = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] volume_copy_bps_limit = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] volume_dd_blocksize = 1M {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] volume_name_template = volume-%s {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] volume_service_inithost_offload = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] volume_usage_audit_period = month {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] zoning_mode = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_concurrency.disable_process_locking = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.auth_section = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.auth_type = password {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.auth_version = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.cache = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.certfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.delay_auth_decision = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.http_connect_timeout = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.include_service_catalog = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.insecure = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.interface = public {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.keyfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_password = {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93919]: INFO cinder.volume.manager [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Starting volume driver QuobyteDriver (1.1.14) Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcache_username = {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.region_name = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.service_token_roles_required = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.service_type = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.token_cache_time = 300 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.97/identity {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.backend = dogpile.cache.null {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.backend_argument = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.backend_expiration_time = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.remotefs [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93919) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.config_prefix = cache.oslo {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.debug_cache_backend = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.enable_retry_client = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.enable_socket_keepalive = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.enabled = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.expiration_time = 600 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.hashclient_retry_attempts = 2 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.memcache_dead_retry = 300 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.memcache_pool_maxsize = 10 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.memcache_sasl_enabled = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.password = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.proxies = [] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.redis_db = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.redis_sentinel_service_name = mymaster {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.redis_server = localhost:6379 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.retry_attempts = 2 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.retry_delay = 0.0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.socket_keepalive_count = 1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.socket_keepalive_idle = 1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.socket_keepalive_interval = 1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.socket_timeout = 1.0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.tls_allowed_ciphers = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.tls_cafile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.tls_certfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.tls_enabled = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.tls_keyfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cache.username = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] coordination.backend_url = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.asyncio_connection = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.asyncio_slave_connection = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.backend = sqlalchemy {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.connection = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.connection_debug = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.connection_parameters = {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.connection_recycle_time = 3600 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.connection_trace = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.db_inc_retry_interval = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.db_max_retries = 20 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.db_max_retry_interval = 10 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.db_retry_interval = 1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.max_overflow = 50 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.max_pool_size = 5 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.max_retries = 10 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.mysql_wsrep_sync_wait = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.pool_timeout = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.retry_interval = 10 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.slave_connection = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.sqlite_synchronous = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.synchronous_reader = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] database.use_db_reconnect = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] profiler.connection_string = messaging:// {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] profiler.enabled = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] profiler.es_doc_type = notification {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] profiler.es_scroll_size = 10000 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] profiler.es_scroll_time = 2m {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] profiler.filter_error_trace = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] profiler.hmac_keys = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] profiler.sentinel_service_name = mymaster {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] profiler.socket_timeout = 0.1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] profiler.trace_requests = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] profiler.trace_sqlalchemy = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] profiler_jaeger.process_tags = {} {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] profiler_jaeger.service_name_prefix = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] profiler_otlp.service_name_prefix = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_policy.enforce_new_defaults = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_policy.policy_default_rule = default {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_policy.policy_file = policy.yaml {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_policy.remote_timeout = 60.0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] privsep_osbrick.group = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] privsep_osbrick.helper_command = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] privsep_osbrick.user = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cinder_sys_admin.group = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cinder_sys_admin.helper_command = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] cinder_sys_admin.user = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] service_user.auth_section = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] service_user.auth_type = password {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] service_user.cafile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] service_user.certfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] service_user.collect_timing = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] service_user.insecure = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] service_user.keyfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] service_user.send_service_user_token = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] service_user.split_loggers = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] service_user.timeout = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance.auth_section = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance.auth_type = password {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance.certfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance.collect_timing = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance.insecure = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance.keyfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance.region_name = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance.split_loggers = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] glance.timeout = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.backend_availability_zone = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.chap_password = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.chap_username = {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.disk_geometry = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.driver_client_cert = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.driver_client_cert_key = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.driver_data_namespace = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.driver_use_ssl = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.enable_unsupported_driver = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.extra_capabilities = {} {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.filter_function = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.goodness_function = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.iscsi_target_flags = {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.iscsi_write_cache = on {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.iser_helper = tgtadm {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.iser_ip_address = 192.168.122.97 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.iser_port = 3260 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.nas_host = {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.nas_login = admin {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.nas_mount_options = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.nas_password = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.nas_private_key = {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.nas_share_path = {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.nas_ssh_port = 22 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.num_shell_tries = 3 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.nvmet_port_id = 1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.quobyte_client_cfg = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.quobyte_volume_url = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.replication_device = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.report_discard_supported = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.reserved_percentage = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.scst_target_driver = iscsi {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.scst_target_iqn_name = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.storage_protocol = iSCSI {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.target_helper = tgtadm {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.target_ip_address = 192.168.122.97 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.target_port = 3260 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.target_protocol = iscsi {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.trace_flags = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.unique_fqdn_network = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.use_chap_auth = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.volume_backend_name = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.volume_clear = zero {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.volume_clear_ionice = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.volume_clear_size = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_reports.file_event_handler = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_reports.log_dir = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.backend_availability_zone = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.backend_host = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.chap_password = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.chap_username = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.chiscsi_conf = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.disk_geometry = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.driver_client_cert = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.driver_client_cert_key = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.driver_data_namespace = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.driver_use_ssl = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.extra_capabilities = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.filter_function = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.goodness_function = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.iscsi_target_flags = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.iscsi_write_cache = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.iser_helper = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.iser_ip_address = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.iser_port = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.iser_target_prefix = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.nas_host = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.nas_login = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.nas_mount_options = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.nas_password = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.nas_private_key = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.nas_share_path = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.nas_ssh_port = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.num_shell_tries = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.nvmet_ns_id = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.nvmet_port_id = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.replication_device = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.report_discard_supported = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.reserved_percentage = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.scst_target_driver = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.storage_protocol = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.target_helper = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.target_ip_address = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.target_port = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.target_prefix = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.target_protocol = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.trace_flags = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.unique_fqdn_network = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.use_chap_auth = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.volume_clear = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.volume_clear_ionice = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.volume_clear_size = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] QuobyteHD.volumes_dir = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93919) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Aug 13 09:20:23 devstack cinder-volume[93919]: WARNING cinder.volume.drivers.quobyte [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93919]: WARNING cinder.volume.drivers.quobyte [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.ssl = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Running cmd (subprocess): mount.quobyte {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.ssl_version = {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_notifications.driver = [] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_notifications.retry = -1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] oslo_messaging_notifications.transport_url = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] key_manager.fixed_key = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.barbican_api_version = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.barbican_endpoint = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.barbican_endpoint_type = public {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.barbican_region_name = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.cafile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.certfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.collect_timing = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.insecure = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.keyfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.number_of_retries = 60 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.retry_delay = 1 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.send_service_user_token = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.split_loggers = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.timeout = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.verify_ssl = True {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican.verify_ssl_path = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican_service_user.auth_section = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican_service_user.auth_type = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican_service_user.cafile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican_service_user.certfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican_service_user.collect_timing = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican_service_user.insecure = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican_service_user.keyfile = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican_service_user.split_loggers = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] barbican_service_user.timeout = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vault.approle_role_id = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vault.approle_secret_id = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vault.auth_method = approle {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vault.auth_path = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vault.kv_mountpoint = secret {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vault.kv_path = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vault.kv_version = 2 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vault.namespace = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vault.root_token_id = **** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vault.ssl_ca_crt_file = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vault.timeout = 60.0 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vault.token_file = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vault.token_role = None {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vault.use_ssl = False {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:23 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] ******************************************************************************** {{(pid=93697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 13 09:20:23 devstack quobyte-client[93925]: Reading configuration file: /etc/quobyte/client.cfg Aug 13 09:20:23 devstack quobyte-client[93925]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 13 09:20:23 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] CMD "mount.quobyte" returned: 1 in 0.096s {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:20:23 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:20:23 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:20:23 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=93919) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:20:23 devstack cinder-volume[93919]: INFO cinder.volume.drivers.quobyte [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 ... Aug 13 09:20:23 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 -c /etc/quobyte/client-cinder.cfg {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:20:23 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 -c /etc/quobyte/client-cinder.cfg Aug 13 09:20:23 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:20:23 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Aug 13 09:20:23 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.371s {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:20:23 devstack cinder-volume[93919]: INFO cinder.volume.drivers.quobyte [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 succeeded Aug 13 09:20:23 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=93919) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:20:23 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.381s {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:20:23 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:20:23 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:20:23 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:20:24 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.244s {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:20:24 devstack cinder-volume[93919]: INFO cinder.volume.driver [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Driver hasn't implemented _init_vendor_properties() Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG cinder.volume.driver [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93919) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG oslo_db.sqlalchemy.engines [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93919) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG dbcounter [-] [93919] Writer thread running {{(pid=93919) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG cinder.db.api [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Building query based on filter {{(pid=93919) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG cinder.image.image_utils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93919) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 13 09:20:24 devstack cinder-volume[93919]: INFO cinder.keymgr.migration [None req-b19c76fb-ca20-4749-bd74-acc929878a4a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=93919) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=93919) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:20:24 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:20:24 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:20:24 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.245s {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG cinder.manager [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Notifying Schedulers of capabilities ... {{(pid=93919) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:20:24 devstack cinder-volume[93919]: INFO cinder.volume.manager [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Driver initialization completed successfully. Aug 13 09:20:24 devstack cinder-volume[93919]: INFO cinder.manager [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Initiating service 3 cleanup Aug 13 09:20:24 devstack cinder-volume[93919]: INFO cinder.manager [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Service 3 cleanup completed. Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG cinder.service [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Creating RPC server for service cinder-volume {{(pid=93919) start /opt/stack/cinder/cinder/service.py:231}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG cinder.service [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93919) start /opt/stack/cinder/cinder/service.py:237}} Aug 13 09:20:24 devstack cinder-volume[93919]: INFO cinder.volume.manager [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=93919) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=93919) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:20:24 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:20:24 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:20:24 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Aug 13 09:20:24 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.247s {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:20:24 devstack cinder-volume[93919]: INFO cinder.volume.manager [None req-33bfb036-6d0d-4dc2-842c-a37c4651fef8 None None] Driver post RPC initialization completed successfully. Aug 13 09:20:29 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-b994ae39-ae19-4af1-9e04-41cf3d84efdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:20:29 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-b994ae39-ae19-4af1-9e04-41cf3d84efdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:20:29 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-b994ae39-ae19-4af1-9e04-41cf3d84efdb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=93919) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:20:29 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-b994ae39-ae19-4af1-9e04-41cf3d84efdb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=93919) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:20:29 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-b994ae39-ae19-4af1-9e04-41cf3d84efdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:20:29 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-b994ae39-ae19-4af1-9e04-41cf3d84efdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:20:29 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:20:29 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:20:29 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Aug 13 09:20:29 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-b994ae39-ae19-4af1-9e04-41cf3d84efdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.241s {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:20:29 devstack cinder-volume[93919]: DEBUG cinder.manager [None req-b994ae39-ae19-4af1-9e04-41cf3d84efdb None None] Notifying Schedulers of capabilities ... {{(pid=93919) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:20:32 devstack cinder-volume[93697]: INFO oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Caught SIGTERM, stopping children Aug 13 09:20:32 devstack cinder-volume[93697]: DEBUG oslo_concurrency.lockutils [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Acquiring lock "singleton_lock" {{(pid=93697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 13 09:20:32 devstack cinder-volume[93697]: DEBUG oslo_concurrency.lockutils [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Acquired lock "singleton_lock" {{(pid=93697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 13 09:20:32 devstack cinder-volume[93697]: DEBUG oslo_concurrency.lockutils [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Releasing lock "singleton_lock" {{(pid=93697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 13 09:20:32 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Stop services. {{(pid=93697) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 13 09:20:32 devstack cinder-volume[93697]: DEBUG oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Killing children. {{(pid=93697) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 13 09:20:32 devstack cinder-volume[93697]: INFO oslo_service.backend._eventlet.service [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Waiting on 1 children to exit Aug 13 09:20:34 devstack cinder-volume[93919]: DEBUG dbcounter [-] [93919] Writing DB stats cinder:SELECT=3 {{(pid=93919) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:20:34 devstack cinder-volume[93919]: DEBUG dbcounter [-] [93919] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=93919) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:20:36 devstack cinder-volume[93919]: DEBUG oslo_service.periodic_task [None req-a25a855a-60a6-417c-b82d-668d72c35cc1 None None] Running periodic task VolumeManager._thread_info {{(pid=93919) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:20:36 devstack cinder-volume[93919]: DEBUG cinder.volume.manager [None req-a25a855a-60a6-417c-b82d-668d72c35cc1 None None] thread count: 6 {{(pid=93919) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:20:36 devstack cinder-volume[93919]: DEBUG cinder.volume.manager [None req-a25a855a-60a6-417c-b82d-668d72c35cc1 None None] thread info: [<_MainThread(MainThread, started 139867518374016)>, , , , , ] {{(pid=93919) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:20:37 devstack cinder-volume[93919]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Aug 13 09:20:37 devstack cinder-volume[94372]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 13 09:20:37 devstack cinder-volume[94372]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 13 09:20:37 devstack cinder-volume[94372]: we strongly recommend against using it for new projects. Aug 13 09:20:37 devstack cinder-volume[94372]: If you are already using Eventlet, we recommend migrating to a different Aug 13 09:20:37 devstack cinder-volume[94372]: framework. For more detail see Aug 13 09:20:37 devstack cinder-volume[94372]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 13 09:20:37 devstack cinder-volume[94372]: import eventlet # noqa Aug 13 09:20:37 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Acquiring lock "singleton_lock" {{(pid=93919) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 13 09:20:37 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Acquired lock "singleton_lock" {{(pid=93919) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 13 09:20:37 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Releasing lock "singleton_lock" {{(pid=93919) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 13 09:20:37 devstack cinder-volume[93919]: WARNING amqp [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 13 09:20:37 devstack cinder-volume[93919]: WARNING amqp [None req-cd2acdc5-0867-48da-ad46-95c7509bb8ea None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 13 09:20:40 devstack cinder-volume[94372]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94372) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 13 09:20:40 devstack cinder-volume[94372]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94372) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 13 09:20:40 devstack cinder-volume[94372]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94372) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 13 09:20:41 devstack cinder-volume[94372]: INFO dbcounter [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] Registered counter for database cinder Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_db.sqlalchemy.engines [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94372) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG dbcounter [-] [94372] Writer thread running {{(pid=94372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 13 09:20:41 devstack cinder-volume[94372]: INFO cinder.rpc [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 13 09:20:41 devstack cinder-volume[94372]: INFO cinder.rpc [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_db.sqlalchemy.engines [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94372) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 13 09:20:41 devstack cinder-volume[94372]: INFO cinder.volume.manager [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] Determined volume DB was empty at startup. Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG cinder.volume.manager [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94372) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 13 09:20:41 devstack cinder-volume[94372]: WARNING stevedore.named [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 13 09:20:41 devstack cinder-volume[94372]: WARNING castellan.key_manager [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 13 09:20:41 devstack cinder-volume[94372]: WARNING cinder.keymgr.conf_key_mgr [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 13 09:20:41 devstack cinder-volume[94372]: INFO cinder.volume.manager [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_db.sqlalchemy.engines [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94372) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 13 09:20:41 devstack cinder-volume[94372]: INFO oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] Starting 1 workers Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] Started child 94670 {{(pid=94372) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] Full set of CONF: {{(pid=94372) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] ******************************************************************************** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] Configuration options gathered from: {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] ================================================================================ {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 13 09:20:41 devstack cinder-volume[94670]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] allow_availability_zone_fallback = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] allow_compression_on_image_upload = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] allowed_direct_url_schemes = [] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] api_rate_limit = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] auth_strategy = keystone {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_availability_zone = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_host = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_name = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_stats_polling_interval = 60 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backup_api_class = cinder.backup.api.API {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backup_name_template = backup-%s {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backup_use_same_host = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backup_use_temp_snapshot = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] chap_password = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] chap_username = {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cinder_internal_tenant_project_id = dbd88289500d46d0966a01fb0dd72db7 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cinder_internal_tenant_user_id = 6db85268742a40769839318f215da7de {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cluster = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] compression_format = gzip {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] compute_api_class = cinder.compute.nova.API {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] config_dir = [] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] config_source = [] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] control_exchange = openstack {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] debug = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] default_availability_zone = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] default_group_type = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] default_volume_type = QuobyteHD {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] disk_geometry = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] driver_client_cert = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] driver_client_cert_key = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] driver_data_namespace = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] driver_ssl_cert_path = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] driver_ssl_cert_verify = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] driver_use_ssl = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] enable_new_services = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] enable_unsupported_driver = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] enabled_backends = ['QuobyteHD'] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] enforce_multipath_for_image_xfer = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] filter_function = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance_api_insecure = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance_api_servers = ['http://192.168.122.97/image'] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance_api_ssl_compression = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance_ca_certificates_file = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance_catalog_info = image:glance:publicURL {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance_certfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance_keyfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance_num_retries = 3 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance_request_timeout = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] goodness_function = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] graceful_shutdown_timeout = 5 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] group_api_class = cinder.group.api.API {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] host = devstack {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] image_compress_on_upload = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] image_conversion_address_space_limit = 1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] image_conversion_cpu_limit = 60 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] image_conversion_disable = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] image_upload_use_cinder_backend = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] image_upload_use_internal_tenant = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] image_volume_cache_enabled = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] image_volume_cache_max_count = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] image_volume_cache_max_size_gb = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] init_host_max_objects_retrieval = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] instance_format = [instance: %(uuid)s] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] iscsi_target_flags = {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] iscsi_write_cache = on {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] iser_helper = tgtadm {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] iser_ip_address = 192.168.122.97 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] iser_port = 3260 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] log_color = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] log_config_append = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] log_dir = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] log_file = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] log_options = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] log_rotate_interval = 1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] log_rotate_interval_type = days {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] log_rotation_type = none {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] max_age = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] max_logfile_count = 30 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] max_logfile_size_mb = 200 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] max_over_subscription_ratio = 20.0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] message_reap_interval = 86400 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] message_ttl = 2592000 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] migration_create_volume_timeout_secs = 300 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] monkey_patch = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] monkey_patch_modules = [] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] my_ip = 192.168.122.97 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] no_snapshot_gb_quota = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] num_iser_scan_tries = 3 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] num_shell_tries = 3 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] num_volume_device_scan_tries = 3 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] nvmeof_conn_info_version = 1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] nvmet_ns_id = 10 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] nvmet_port_id = 1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] osapi_max_limit = 1000 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] osapi_volume_ext_list = [] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] osapi_volume_listen_port = 8776 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] osapi_volume_use_ssl = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] osapi_volume_workers = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] per_volume_size_limit = -1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] periodic_fuzzy_delay = 60 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] periodic_interval = 60 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] public_endpoint = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] publish_errors = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] quota_backup_gigabytes = 1000 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] quota_backups = 10 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] quota_gigabytes = 1000 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] quota_groups = 10 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] quota_snapshots = 10 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] quota_volumes = 10 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] rate_limit_burst = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] rate_limit_except_level = CRITICAL {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] rate_limit_interval = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] reinit_driver_count = 3 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] replication_device = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] report_discard_supported = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] report_interval = 120 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] reservation_clean_interval = 86400 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] reservation_expire = 86400 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] reserved_image_namespaces = [] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] reserved_percentage = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] rpc_response_timeout = 120 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] run_external_periodic_tasks = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] scst_target_driver = iscsi {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Starting volume driver QuobyteDriver (1.1.14) Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] scst_target_iqn_name = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] service_down_time = 720 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] shell_completion = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] snapshot_name_template = snapshot-%s {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] split_loggers = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] state_path = /opt/stack/data/cinder {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] storage_availability_zone = nova {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] storage_protocol = iSCSI {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] syslog_log_facility = LOG_USER {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] target_helper = lioadm {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] target_ip_address = 192.168.122.97 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] target_port = 3260 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] target_protocol = iscsi {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] target_secondary_ip_addresses = [] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] trace_flags = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] transport_url = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] until_refresh = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] use_chap_auth = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b5590f43-f715-4a29-8874-173c155e703e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94670) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] use_default_quota_class = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] use_journal = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] use_json = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] use_multipath_for_image_xfer = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] use_stderr = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] use_syslog = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] verify_glance_signatures = enabled {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] volume_api_class = cinder.volume.api.API {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] volume_backend_name = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] volume_clear = zero {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] volume_clear_ionice = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] volume_clear_size = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] volume_copy_bps_limit = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] volume_dd_blocksize = 1M {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] volume_name_template = volume-%s {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] volume_service_inithost_offload = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] volume_usage_audit_period = month {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] zoning_mode = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_concurrency.disable_process_locking = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.auth_section = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.auth_type = password {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.auth_version = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.cache = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.certfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.include_service_catalog = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.insecure = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.interface = public {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.keyfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_password = {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcache_username = {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.region_name = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.service_type = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.97/identity {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.backend = dogpile.cache.null {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.backend_argument = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.backend_expiration_time = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.config_prefix = cache.oslo {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.debug_cache_backend = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.enable_retry_client = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.enable_socket_keepalive = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.enabled = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.expiration_time = 600 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.hashclient_retry_attempts = 2 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.memcache_dead_retry = 300 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.memcache_pool_maxsize = 10 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.memcache_sasl_enabled = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.password = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.proxies = [] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.redis_db = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.redis_server = localhost:6379 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.retry_attempts = 2 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.retry_delay = 0.0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.socket_keepalive_count = 1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.socket_keepalive_idle = 1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.socket_keepalive_interval = 1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.socket_timeout = 1.0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.tls_allowed_ciphers = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.tls_cafile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.tls_certfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.tls_enabled = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.tls_keyfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cache.username = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] coordination.backend_url = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.asyncio_connection = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.asyncio_slave_connection = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.backend = sqlalchemy {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.connection = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.connection_debug = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.connection_parameters = {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.connection_recycle_time = 3600 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.connection_trace = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.db_inc_retry_interval = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.db_max_retries = 20 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.db_max_retry_interval = 10 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.db_retry_interval = 1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.max_overflow = 50 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.max_pool_size = 5 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.max_retries = 10 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.mysql_wsrep_sync_wait = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.pool_timeout = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.retry_interval = 10 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.slave_connection = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.sqlite_synchronous = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.synchronous_reader = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] database.use_db_reconnect = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] profiler.connection_string = messaging:// {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] profiler.enabled = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] profiler.es_doc_type = notification {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] profiler.es_scroll_size = 10000 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] profiler.es_scroll_time = 2m {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] profiler.filter_error_trace = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] profiler.hmac_keys = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] profiler.sentinel_service_name = mymaster {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] profiler.socket_timeout = 0.1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] profiler.trace_requests = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] profiler.trace_sqlalchemy = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] profiler_jaeger.process_tags = {} {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] profiler_jaeger.service_name_prefix = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] profiler_otlp.service_name_prefix = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_policy.enforce_new_defaults = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_policy.policy_default_rule = default {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_policy.policy_file = policy.yaml {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] privsep_osbrick.group = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] privsep_osbrick.helper_command = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] privsep_osbrick.user = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cinder_sys_admin.group = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cinder_sys_admin.helper_command = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] cinder_sys_admin.user = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] service_user.auth_section = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] service_user.auth_type = password {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] service_user.cafile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] service_user.certfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] service_user.collect_timing = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] service_user.insecure = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] service_user.keyfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] service_user.send_service_user_token = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] service_user.split_loggers = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] service_user.timeout = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance.auth_section = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance.auth_type = password {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance.certfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance.collect_timing = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance.insecure = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance.keyfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance.region_name = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance.split_loggers = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] glance.timeout = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.backend_availability_zone = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.chap_password = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.chap_username = {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.disk_geometry = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.driver_client_cert = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.driver_client_cert_key = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.driver_data_namespace = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.driver_use_ssl = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.extra_capabilities = {} {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.filter_function = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b5590f43-f715-4a29-8874-173c155e703e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94670) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Aug 13 09:20:41 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.quobyte [None req-b5590f43-f715-4a29-8874-173c155e703e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 13 09:20:41 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.quobyte [None req-b5590f43-f715-4a29-8874-173c155e703e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 13 09:20:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Running cmd (subprocess): mount.quobyte {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.goodness_function = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.iscsi_target_flags = {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.iscsi_write_cache = on {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.iser_helper = tgtadm {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.iser_ip_address = 192.168.122.97 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.iser_port = 3260 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.nas_host = {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.nas_login = admin {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.nas_mount_options = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.nas_password = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.nas_private_key = {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.nas_share_path = {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.num_shell_tries = 3 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.quobyte_volume_url = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.replication_device = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.report_discard_supported = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.reserved_percentage = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.target_helper = tgtadm {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.target_ip_address = 192.168.122.97 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.target_port = 3260 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.target_protocol = iscsi {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.trace_flags = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.unique_fqdn_network = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.use_chap_auth = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.volume_backend_name = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.volume_clear = zero {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.volume_clear_ionice = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.volume_clear_size = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_reports.file_event_handler = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_reports.log_dir = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.backend_availability_zone = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.backend_host = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.chap_password = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.chap_username = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.chiscsi_conf = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.disk_geometry = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.driver_client_cert = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.driver_data_namespace = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.driver_use_ssl = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.extra_capabilities = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.filter_function = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.goodness_function = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.iser_helper = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.iser_ip_address = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.iser_port = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.iser_target_prefix = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.nas_host = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.nas_login = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.nas_mount_options = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.nas_password = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.nas_private_key = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack quobyte-client[94679]: Reading configuration file: /etc/quobyte/client.cfg Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.nas_share_path = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.nas_ssh_port = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.num_shell_tries = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack quobyte-client[94679]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.nvmet_port_id = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:20:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.replication_device = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.report_discard_supported = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:20:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.reserved_percentage = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.scst_target_driver = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.storage_protocol = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.target_helper = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.target_ip_address = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.target_port = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.target_prefix = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.target_protocol = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.trace_flags = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.use_chap_auth = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.volume_clear = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.volume_clear_size = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] QuobyteHD.volumes_dir = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.ssl = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_notifications.driver = [] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_notifications.retry = -1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] key_manager.fixed_key = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.barbican_api_version = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.barbican_endpoint = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.barbican_endpoint_type = public {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.barbican_region_name = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.cafile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.certfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.collect_timing = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.insecure = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.keyfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.number_of_retries = 60 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.retry_delay = 1 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.send_service_user_token = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.split_loggers = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.timeout = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.verify_ssl = True {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican.verify_ssl_path = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican_service_user.auth_section = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican_service_user.auth_type = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican_service_user.cafile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican_service_user.certfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican_service_user.collect_timing = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican_service_user.insecure = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican_service_user.keyfile = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican_service_user.split_loggers = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] barbican_service_user.timeout = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vault.approle_role_id = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vault.approle_secret_id = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vault.auth_method = approle {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vault.auth_path = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vault.kv_mountpoint = secret {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vault.kv_path = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vault.kv_version = 2 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vault.namespace = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vault.root_token_id = **** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vault.ssl_ca_crt_file = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vault.timeout = 60.0 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vault.token_file = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vault.token_role = None {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vault.use_ssl = False {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 13 09:20:41 devstack cinder-volume[94372]: DEBUG oslo_service.backend._eventlet.service [None req-dca53f2d-664a-410a-8686-c3ff493062d4 None None] ******************************************************************************** {{(pid=94372) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 13 09:20:42 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.252s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:20:42 devstack cinder-volume[94670]: INFO cinder.volume.driver [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Driver hasn't implemented _init_vendor_properties() Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG cinder.volume.driver [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94670) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG oslo_db.sqlalchemy.engines [None req-b5590f43-f715-4a29-8874-173c155e703e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94670) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writer thread running {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG cinder.db.api [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Building query based on filter {{(pid=94670) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94670) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:20:42 devstack cinder-volume[94670]: INFO cinder.keymgr.migration [None req-df6b2155-cef3-40e2-87f2-08f1a2c3d658 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 13 09:20:42 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:20:42 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.312s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:20:42 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Aug 13 09:20:42 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Driver initialization completed successfully. Aug 13 09:20:42 devstack cinder-volume[94670]: INFO cinder.manager [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Initiating service 3 cleanup Aug 13 09:20:42 devstack cinder-volume[94670]: INFO cinder.manager [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Service 3 cleanup completed. Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG cinder.service [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Creating RPC server for service cinder-volume {{(pid=94670) start /opt/stack/cinder/cinder/service.py:231}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG cinder.service [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94670) start /opt/stack/cinder/cinder/service.py:237}} Aug 13 09:20:42 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:20:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:20:42 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:20:42 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:20:43 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Aug 13 09:20:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b5590f43-f715-4a29-8874-173c155e703e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.300s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:20:43 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b5590f43-f715-4a29-8874-173c155e703e None None] Driver post RPC initialization completed successfully. Aug 13 09:20:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:20:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 6 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:20:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:20:51 devstack cinder-volume[94372]: DEBUG dbcounter [-] [94372] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:20:52 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=3 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:20:53 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:21:40 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Flow 'volume_create_manager' (16e9e37c-2f75-4abf-8dcb-85c563969e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6d7a1c-51a8-4003-a32b-7a15c19568b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6d7a1c-51a8-4003-a32b-7a15c19568b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-149946393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c136696-02e2-48cc-a214-a719b60b0685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0234dd01a3241c39e065f8428f8b02a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:21:41Z,use_quota=True,user_id='b2009c7cf8b648fd8c8a0d4be2364275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6de3f3f-5f44-44b9-9cdb-0cb16814a1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6de3f3f-5f44-44b9-9cdb-0cb16814a1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8277310e-562e-41c1-95c6-6108556caef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8277310e-562e-41c1-95c6-6108556caef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c136696-02e2-48cc-a214-a719b60b0685', 'volume_name': 'volume-4c136696-02e2-48cc-a214-a719b60b0685', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298edd85-3b87-40f1-b5dc-1fbed250a938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298edd85-3b87-40f1-b5dc-1fbed250a938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd2bdf6-3438-4778-86d2-0436087d32ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:21:41 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Volume 4c136696-02e2-48cc-a214-a719b60b0685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c136696-02e2-48cc-a214-a719b60b0685', 'volume_size': 1} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-149946393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c136696-02e2-48cc-a214-a719b60b0685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0234dd01a3241c39e065f8428f8b02a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:21:41Z,use_quota=True,user_id='b2009c7cf8b648fd8c8a0d4be2364275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Creating volume 4c136696-02e2-48cc-a214-a719b60b0685 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:21:41 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4c136696-02e2-48cc-a214-a719b60b0685 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:21:41 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4c136696-02e2-48cc-a214-a719b60b0685 1073741824 Aug 13 09:21:41 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:21:41 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4c136696-02e2-48cc-a214-a719b60b0685 1073741824" returned: 0 in 0.637s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:21:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4c136696-02e2-48cc-a214-a719b60b0685 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:21:41 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4c136696-02e2-48cc-a214-a719b60b0685 Aug 13 09:21:41 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:21:42 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Aug 13 09:21:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4c136696-02e2-48cc-a214-a719b60b0685" returned: 0 in 0.364s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:21:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:21:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:21:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd2bdf6-3438-4778-86d2-0436087d32ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c136696-02e2-48cc-a214-a719b60b0685', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:21:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a1ea54-ae38-44a5-9805-19ef5777174c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:21:42 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Volume volume-4c136696-02e2-48cc-a214-a719b60b0685 (4c136696-02e2-48cc-a214-a719b60b0685): created successfully Aug 13 09:21:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a1ea54-ae38-44a5-9805-19ef5777174c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:21:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Flow 'volume_create_manager' (16e9e37c-2f75-4abf-8dcb-85c563969e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:21:42 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-482bd64c-f13c-4ca8-aa34-ff1993ba81e1 tempest-TaggedAttachmentsTest-1842892093 None] Created volume successfully. Aug 13 09:21:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:21:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:21:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:21:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:21:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:21:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:21:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:21:43 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:21:43 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:21:43 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Aug 13 09:21:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.349s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:21:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:21:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:21:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 6 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:21:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:21:52 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:21:52 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Flow 'volume_create_manager' (03d0524d-e7da-4989-83b9-9638e0297862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842ee0e5-bce2-42ce-9cb3-7f1a915e5907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842ee0e5-bce2-42ce-9cb3-7f1a915e5907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1700613344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47e0eb6-bb19-42e8-8668-f21f00ecca2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a606b3b76e147718832484b0aa6535e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:22:09Z,use_quota=True,user_id='d2c40075b20147d3889d21213ef34c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bb61a3-ed5e-47f0-b755-f90d253346f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bb61a3-ed5e-47f0-b755-f90d253346f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5493f90e-2fbc-4385-a1cc-c285625ecbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5493f90e-2fbc-4385-a1cc-c285625ecbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e47e0eb6-bb19-42e8-8668-f21f00ecca2f', 'volume_name': 'volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee22a61-54f1-4bc9-a3d3-781e10807c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee22a61-54f1-4bc9-a3d3-781e10807c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084dab6b-fc0a-47e1-b84e-355e2273e4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:22:08 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Volume e47e0eb6-bb19-42e8-8668-f21f00ecca2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f', 'volume_size': 1} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1700613344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47e0eb6-bb19-42e8-8668-f21f00ecca2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a606b3b76e147718832484b0aa6535e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:22:09Z,use_quota=True,user_id='d2c40075b20147d3889d21213ef34c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Creating volume e47e0eb6-bb19-42e8-8668-f21f00ecca2f {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:22:08 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:22:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:22:09 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f 1073741824 Aug 13 09:22:09 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:22:09 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Aug 13 09:22:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f 1073741824" returned: 0 in 1.010s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:22:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:22:10 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f Aug 13 09:22:10 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:22:10 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Aug 13 09:22:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f" returned: 0 in 0.517s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:22:10 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:22:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:22:10 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084dab6b-fc0a-47e1-b84e-355e2273e4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:22:10 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e68b0a-db5e-4a96-9354-c0c8551de969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:22:10 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Volume volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f (e47e0eb6-bb19-42e8-8668-f21f00ecca2f): created successfully Aug 13 09:22:10 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e68b0a-db5e-4a96-9354-c0c8551de969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:22:10 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Flow 'volume_create_manager' (03d0524d-e7da-4989-83b9-9638e0297862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:22:10 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5316e5dd-fa72-4e3b-980a-b8021ab43f84 tempest-VolumesAdminNegativeTest-709729536 None] Created volume successfully. Aug 13 09:22:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Acquiring lock "cinder-e47e0eb6-bb19-42e8-8668-f21f00ecca2f-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:22:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Lock "cinder-e47e0eb6-bb19-42e8-8668-f21f00ecca2f-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:22:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Acquiring lock "cinder-quobyte-e47e0eb6-bb19-42e8-8668-f21f00ecca2f" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:22:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Lock "cinder-quobyte-e47e0eb6-bb19-42e8-8668-f21f00ecca2f" acquired by "delete_volume" :: waited 0.037s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:22:12 devstack cinder-volume[94670]: INFO oslo.privsep.daemon [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp73y85_m1/privsep.sock'] Aug 13 09:22:12 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp73y85_m1/privsep.sock Aug 13 09:22:12 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:22:13 devstack cinder-volume[94670]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 13 09:22:13 devstack cinder-volume[94670]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 13 09:22:13 devstack cinder-volume[94670]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 13 09:22:13 devstack cinder-volume[94670]: WARNING oslo.privsep.daemon [-] privsep log: Aug 13 09:22:13 devstack cinder-volume[94670]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 13 09:22:13 devstack cinder-volume[94670]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 13 09:22:13 devstack cinder-volume[94670]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 13 09:22:13 devstack cinder-volume[94670]: WARNING oslo.privsep.daemon [-] privsep log: Aug 13 09:22:13 devstack cinder-volume[94670]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 13 09:22:14 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Aug 13 09:22:14 devstack cinder-volume[94670]: INFO oslo.privsep.daemon [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Spawned new privsep daemon via rootwrap Aug 13 09:22:14 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Accepted privsep connection to /tmp/tmp73y85_m1/privsep.sock {{(pid=94670) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 13 09:22:14 devstack cinder-volume[94670]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 13 09:22:14 devstack cinder-volume[94670]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 13 09:22:14 devstack cinder-volume[94670]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 13 09:22:14 devstack cinder-volume[94670]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95669 Aug 13 09:22:14 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4068a2e-7079-40f6-b402-520ca454d4a1]: (2,) {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:22:14 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[04067e48-48c1-463b-852d-28526e27ae92]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:22:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:22:14 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f Aug 13 09:22:14 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:22:14 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Aug 13 09:22:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f" returned: 0 in 0.768s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:22:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:22:15 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f Aug 13 09:22:15 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:22:15 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Aug 13 09:22:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e47e0eb6-bb19-42e8-8668-f21f00ecca2f" returned: 0 in 0.644s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:22:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Lock "cinder-quobyte-e47e0eb6-bb19-42e8-8668-f21f00ecca2f" released by "delete_volume" :: held 3.403s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:22:15 devstack cinder-volume[94670]: WARNING cinder.quota [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:22:15 devstack cinder-volume[94670]: WARNING cinder.quota [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:22:15 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Created reservations ['ba16d57b-579d-4cb2-b18a-e447d283876f', '5dc968ad-48c4-4197-83fb-c01e5a3dc97b', 'f42c858d-bcb8-4c80-964b-7e38bb4c2127', '6fa74373-3f6f-491c-aeb1-abcc2aa1ad44'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:22:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:22:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:22:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:22:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:22:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:22:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:22:15 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:22:15 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:22:16 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Aug 13 09:22:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.443s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:22:16 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:22:16 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Deleted volume successfully. Aug 13 09:22:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-138e97a5-a7ac-426a-8189-bfbe8e3c92cf tempest-VolumesAdminNegativeTest-709729536 None] Lock "cinder-e47e0eb6-bb19-42e8-8668-f21f00ecca2f-delete_volume" released by "delete_volume" :: held 4.322s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:22:25 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=6,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=3 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:22:26 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Flow 'volume_create_manager' (52ee9ba9-0765-4f7b-bed0-18aab3a6f66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6563c2-797b-4d38-a144-6c0603fadeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6563c2-797b-4d38-a144-6c0603fadeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1415171033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e891031-859c-4885-80d1-195e50b5f7bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ed6d6ab3504b38874813a497d0407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:22:31Z,use_quota=True,user_id='a9056a04acd143adaf6084c703e56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f3df36-cc04-4bd6-b4ea-75b7d82b98c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f3df36-cc04-4bd6-b4ea-75b7d82b98c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcda1e7-b7b3-4a26-a0d9-5d6434146a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcda1e7-b7b3-4a26-a0d9-5d6434146a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e891031-859c-4885-80d1-195e50b5f7bd', 'volume_name': 'volume-6e891031-859c-4885-80d1-195e50b5f7bd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b175d64-de81-46ae-b224-8e992d47c201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b175d64-de81-46ae-b224-8e992d47c201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545017ac-0de8-4169-bf9a-dcebd00b12ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:22:31 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Volume 6e891031-859c-4885-80d1-195e50b5f7bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e891031-859c-4885-80d1-195e50b5f7bd', 'volume_size': 1} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1415171033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e891031-859c-4885-80d1-195e50b5f7bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ed6d6ab3504b38874813a497d0407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:22:31Z,use_quota=True,user_id='a9056a04acd143adaf6084c703e56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Creating volume 6e891031-859c-4885-80d1-195e50b5f7bd {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:22:31 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:22:31 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd 1073741824 Aug 13 09:22:31 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:22:31 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd 1073741824" returned: 0 in 0.541s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:22:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:22:31 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd Aug 13 09:22:31 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:22:32 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Aug 13 09:22:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd" returned: 0 in 0.248s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:22:32 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:22:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:22:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545017ac-0de8-4169-bf9a-dcebd00b12ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e891031-859c-4885-80d1-195e50b5f7bd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:22:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef409241-e611-4c37-9ce0-7db872923ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:22:32 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Volume volume-6e891031-859c-4885-80d1-195e50b5f7bd (6e891031-859c-4885-80d1-195e50b5f7bd): created successfully Aug 13 09:22:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef409241-e611-4c37-9ce0-7db872923ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:22:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Flow 'volume_create_manager' (52ee9ba9-0765-4f7b-bed0-18aab3a6f66e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:22:32 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-41baf452-bba3-48a1-8076-9ea12ebaffac tempest-ServerActionsTestOtherA-1084879756 None] Created volume successfully. Aug 13 09:22:42 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:22:42 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:22:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:22:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:22:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:22:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:22:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:22:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:22:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:22:43 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:22:43 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:22:43 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Aug 13 09:22:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.360s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:22:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:22:53 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:22:53 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:22:55 devstack cinder-volume[94670]: WARNING py.warnings [req-06aec13b-a279-4f60-81e2-79d64e4dedf5 req-6e629c1c-80e9-44f5-844f-1ee1ff5b9cac tempest-TaggedAttachmentsTest-1842892093 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 13 09:22:55 devstack cinder-volume[94670]: .first() Aug 13 09:22:55 devstack cinder-volume[94670]: Aug 13 09:22:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-06aec13b-a279-4f60-81e2-79d64e4dedf5 req-6e629c1c-80e9-44f5-844f-1ee1ff5b9cac tempest-TaggedAttachmentsTest-1842892093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:22:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-06aec13b-a279-4f60-81e2-79d64e4dedf5 req-6e629c1c-80e9-44f5-844f-1ee1ff5b9cac tempest-TaggedAttachmentsTest-1842892093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:22:55 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e6dba1-bd37-40f3-a2aa-03a78c54a0d4]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:22:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-06aec13b-a279-4f60-81e2-79d64e4dedf5 req-6e629c1c-80e9-44f5-844f-1ee1ff5b9cac tempest-TaggedAttachmentsTest-1842892093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4c136696-02e2-48cc-a214-a719b60b0685 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:22:55 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4c136696-02e2-48cc-a214-a719b60b0685 Aug 13 09:22:55 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:22:56 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Aug 13 09:22:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-06aec13b-a279-4f60-81e2-79d64e4dedf5 req-6e629c1c-80e9-44f5-844f-1ee1ff5b9cac tempest-TaggedAttachmentsTest-1842892093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4c136696-02e2-48cc-a214-a719b60b0685" returned: 0 in 0.563s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:22:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-06aec13b-a279-4f60-81e2-79d64e4dedf5 req-6e629c1c-80e9-44f5-844f-1ee1ff5b9cac tempest-TaggedAttachmentsTest-1842892093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.599s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:22:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-06aec13b-a279-4f60-81e2-79d64e4dedf5 req-6e629c1c-80e9-44f5-844f-1ee1ff5b9cac tempest-TaggedAttachmentsTest-1842892093 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-4c136696-02e2-48cc-a214-a719b60b0685', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f89ad74-68fc-47ff-acd9-e5bb7dff5309', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:22:56 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-06aec13b-a279-4f60-81e2-79d64e4dedf5 req-6e629c1c-80e9-44f5-844f-1ee1ff5b9cac tempest-TaggedAttachmentsTest-1842892093 None] attachment_update completed successfully. Aug 13 09:23:01 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-ff8fee72-e310-4c7d-a4ef-e41fd1f89829 req-5752f2e2-c629-426c-9c00-76f1cacd3d3c tempest-TaggedAttachmentsTest-1842892093 None] Terminate volume connection completed successfully. Aug 13 09:23:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-ff8fee72-e310-4c7d-a4ef-e41fd1f89829 req-5752f2e2-c629-426c-9c00-76f1cacd3d3c tempest-TaggedAttachmentsTest-1842892093 None] Deleting attachment 9f89ad74-68fc-47ff-acd9-e5bb7dff5309. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:23:11 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:23:11 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Flow 'volume_create_manager' (ce6ddff9-b104-4225-b9e8-df33f7c4700b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cab3642-001c-49d4-8eb6-bf66c86516e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cab3642-001c-49d4-8eb6-bf66c86516e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1334267419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea64a272-172f-4524-8c4d-fc735b3d517d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e03c058f5c4d6c934cf3d1a26c1ff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:23:15Z,use_quota=True,user_id='0ca340077ebf4233b27553849652331b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0081b24c-6600-4af1-9878-ad97bd608e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0081b24c-6600-4af1-9878-ad97bd608e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb32510-aff3-434b-979c-ebc40917c235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb32510-aff3-434b-979c-ebc40917c235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea64a272-172f-4524-8c4d-fc735b3d517d', 'volume_name': 'volume-ea64a272-172f-4524-8c4d-fc735b3d517d', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1044987-c4f8-4e34-b166-d953ed757986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1044987-c4f8-4e34-b166-d953ed757986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bee894-9f09-40c1-8d7e-02b41c2ed27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:14 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Volume ea64a272-172f-4524-8c4d-fc735b3d517d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea64a272-172f-4524-8c4d-fc735b3d517d', 'volume_size': 1} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1334267419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea64a272-172f-4524-8c4d-fc735b3d517d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e03c058f5c4d6c934cf3d1a26c1ff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:23:15Z,use_quota=True,user_id='0ca340077ebf4233b27553849652331b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Creating volume ea64a272-172f-4524-8c4d-fc735b3d517d {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:23:14 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:23:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ea64a272-172f-4524-8c4d-fc735b3d517d 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:14 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ea64a272-172f-4524-8c4d-fc735b3d517d 1073741824 Aug 13 09:23:14 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-76490b2c-709a-4e0c-9557-447ff1bb68a8 req-c5a2f12b-14eb-4d25-b763-bbcf68670585 tempest-ServerActionsTestOtherA-1084879756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:15 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ea64a272-172f-4524-8c4d-fc735b3d517d 1073741824" returned: 0 in 0.807s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ea64a272-172f-4524-8c4d-fc735b3d517d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:15 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ea64a272-172f-4524-8c4d-fc735b3d517d Aug 13 09:23:15 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:16 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ea64a272-172f-4524-8c4d-fc735b3d517d" returned: 0 in 0.528s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:23:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-76490b2c-709a-4e0c-9557-447ff1bb68a8 req-c5a2f12b-14eb-4d25-b763-bbcf68670585 tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.911s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bee894-9f09-40c1-8d7e-02b41c2ed27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea64a272-172f-4524-8c4d-fc735b3d517d', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100a9df7-17a8-43fe-b3cb-aa171717f763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:16 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9366b4-90c7-4efc-9aa9-139e3a3764a1]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:23:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-76490b2c-709a-4e0c-9557-447ff1bb68a8 req-c5a2f12b-14eb-4d25-b763-bbcf68670585 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:16 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Volume volume-ea64a272-172f-4524-8c4d-fc735b3d517d (ea64a272-172f-4524-8c4d-fc735b3d517d): created successfully Aug 13 09:23:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100a9df7-17a8-43fe-b3cb-aa171717f763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Flow 'volume_create_manager' (ce6ddff9-b104-4225-b9e8-df33f7c4700b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:23:16 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-23ee83b0-5b80-4222-80e1-68fc5b84d702 tempest-ServersNegativeTestJSON-1367647236 None] Created volume successfully. Aug 13 09:23:16 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd Aug 13 09:23:16 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:16 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-76490b2c-709a-4e0c-9557-447ff1bb68a8 req-c5a2f12b-14eb-4d25-b763-bbcf68670585 tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd" returned: 0 in 0.523s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-76490b2c-709a-4e0c-9557-447ff1bb68a8 req-c5a2f12b-14eb-4d25-b763-bbcf68670585 tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.563s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-76490b2c-709a-4e0c-9557-447ff1bb68a8 req-c5a2f12b-14eb-4d25-b763-bbcf68670585 tempest-ServerActionsTestOtherA-1084879756 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-6e891031-859c-4885-80d1-195e50b5f7bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1313871e-395e-4248-b426-fec8a0f0c877', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:23:16 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-76490b2c-709a-4e0c-9557-447ff1bb68a8 req-c5a2f12b-14eb-4d25-b763-bbcf68670585 tempest-ServerActionsTestOtherA-1084879756 None] attachment_update completed successfully. Aug 13 09:23:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Acquiring lock "cinder-4c136696-02e2-48cc-a214-a719b60b0685-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:23:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Lock "cinder-4c136696-02e2-48cc-a214-a719b60b0685-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:23:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Acquiring lock "cinder-quobyte-4c136696-02e2-48cc-a214-a719b60b0685" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:23:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Lock "cinder-quobyte-4c136696-02e2-48cc-a214-a719b60b0685" acquired by "delete_volume" :: waited 0.040s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:23:18 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae26866f-80d4-4ca5-a322-fc59af54e244]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:23:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4c136696-02e2-48cc-a214-a719b60b0685 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:18 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4c136696-02e2-48cc-a214-a719b60b0685 Aug 13 09:23:18 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:18 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4c136696-02e2-48cc-a214-a719b60b0685" returned: 0 in 0.610s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4c136696-02e2-48cc-a214-a719b60b0685 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:18 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4c136696-02e2-48cc-a214-a719b60b0685 Aug 13 09:23:18 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:19 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4c136696-02e2-48cc-a214-a719b60b0685" returned: 0 in 0.392s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Lock "cinder-quobyte-4c136696-02e2-48cc-a214-a719b60b0685" released by "delete_volume" :: held 1.104s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Flow 'volume_create_manager' (bb57a9fa-776b-4908-9f81-49ed8fe533c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06243c1d-647d-4307-a065-537f210b2660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06243c1d-647d-4307-a065-537f210b2660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-338875896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb0b9db-6930-4117-b8a9-6f13a96f94fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e03c058f5c4d6c934cf3d1a26c1ff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:23:19Z,use_quota=True,user_id='0ca340077ebf4233b27553849652331b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2d2a68-8876-49b2-9de7-2df9e932b2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2d2a68-8876-49b2-9de7-2df9e932b2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed27a76-c3d3-40b4-98af-d54aa95b0e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed27a76-c3d3-40b4-98af-d54aa95b0e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fb0b9db-6930-4117-b8a9-6f13a96f94fb', 'volume_name': 'volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a956c0-e56f-47fa-9485-3fa92363dff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a956c0-e56f-47fa-9485-3fa92363dff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a26ef92-4971-4350-8f0e-89ff077a4480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:19 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Volume 9fb0b9db-6930-4117-b8a9-6f13a96f94fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb', 'volume_size': 1} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-338875896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb0b9db-6930-4117-b8a9-6f13a96f94fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e03c058f5c4d6c934cf3d1a26c1ff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:23:19Z,use_quota=True,user_id='0ca340077ebf4233b27553849652331b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Creating volume 9fb0b9db-6930-4117-b8a9-6f13a96f94fb {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:23:19 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:19 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb 1073741824 Aug 13 09:23:19 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Created reservations ['cf002038-4f3e-4aba-a17e-0134515cc2b7', '037f2709-17ce-4451-99e0-0bf38125139a', '588d71fd-d3b6-460f-975c-3e126a10329e', '5d284ea8-75e5-4704-92d9-864b9c0c2cee'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:19 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:23:19 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:19 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Flow 'volume_create_manager' (296c1260-44b6-4b87-a00b-c3052e157a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079553a3-6745-4715-b3e6-dc27a82eba2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079553a3-6745-4715-b3e6-dc27a82eba2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-320532986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43621463-d507-4293-92b6-abe9a0457a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205e679b71084755a5e98ab0a00f28de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:23:20Z,use_quota=True,user_id='9231dba3defd419891991d1d741f1d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faa2eba-4f42-4008-92c5-bfa7aa301830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faa2eba-4f42-4008-92c5-bfa7aa301830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e08bbb4-714c-4674-83d2-473716d92df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e08bbb4-714c-4674-83d2-473716d92df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43621463-d507-4293-92b6-abe9a0457a36', 'volume_name': 'volume-43621463-d507-4293-92b6-abe9a0457a36', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906d0c22-2bd1-44a6-a3e1-ba1457b6f55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906d0c22-2bd1-44a6-a3e1-ba1457b6f55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a82b43-9111-44ec-a754-bac07094ac45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:20 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Volume 43621463-d507-4293-92b6-abe9a0457a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43621463-d507-4293-92b6-abe9a0457a36', 'volume_size': 1} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:20 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb 1073741824" returned: 0 in 0.864s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:20 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.455s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:23:20 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Deleted volume successfully. Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b894efe7-400e-4068-bbb5-741ea36b17f1 tempest-TaggedAttachmentsTest-1842892093 None] Lock "cinder-4c136696-02e2-48cc-a214-a719b60b0685-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:23:20 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb Aug 13 09:23:20 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:20 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb" returned: 0 in 0.360s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-320532986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43621463-d507-4293-92b6-abe9a0457a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205e679b71084755a5e98ab0a00f28de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:23:20Z,use_quota=True,user_id='9231dba3defd419891991d1d741f1d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Creating volume 43621463-d507-4293-92b6-abe9a0457a36 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:23:20 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-43621463-d507-4293-92b6-abe9a0457a36 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a26ef92-4971-4350-8f0e-89ff077a4480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f0759a1-d581-48c6-9f3b-89e55303b729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:20 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-43621463-d507-4293-92b6-abe9a0457a36 1073741824 Aug 13 09:23:20 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:20 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Volume volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb (9fb0b9db-6930-4117-b8a9-6f13a96f94fb): created successfully Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f0759a1-d581-48c6-9f3b-89e55303b729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Flow 'volume_create_manager' (bb57a9fa-776b-4908-9f81-49ed8fe533c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:23:20 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-dfe4a27f-d60a-49af-81e9-17e98eac738e tempest-ServersNegativeTestJSON-1367647236 None] Created volume successfully. Aug 13 09:23:21 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-43621463-d507-4293-92b6-abe9a0457a36 1073741824" returned: 0 in 0.786s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-43621463-d507-4293-92b6-abe9a0457a36 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:21 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-43621463-d507-4293-92b6-abe9a0457a36 Aug 13 09:23:21 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:21 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-43621463-d507-4293-92b6-abe9a0457a36" returned: 0 in 0.474s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:23:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a82b43-9111-44ec-a754-bac07094ac45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43621463-d507-4293-92b6-abe9a0457a36', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ec1ec8-c237-4e87-b32d-00ecf918b812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:22 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Volume volume-43621463-d507-4293-92b6-abe9a0457a36 (43621463-d507-4293-92b6-abe9a0457a36): created successfully Aug 13 09:23:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ec1ec8-c237-4e87-b32d-00ecf918b812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Flow 'volume_create_manager' (296c1260-44b6-4b87-a00b-c3052e157a65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:23:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Acquiring lock "cinder-9fb0b9db-6930-4117-b8a9-6f13a96f94fb-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:23:22 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-43fe08ed-a272-4021-96b8-ce5c678e599d tempest-DeleteServersTestJSON-1317298536 None] Created volume successfully. Aug 13 09:23:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Lock "cinder-9fb0b9db-6930-4117-b8a9-6f13a96f94fb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:23:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Acquiring lock "cinder-quobyte-9fb0b9db-6930-4117-b8a9-6f13a96f94fb" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:23:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Lock "cinder-quobyte-9fb0b9db-6930-4117-b8a9-6f13a96f94fb" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:23:22 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16ad66a-7eac-4c59-ba98-dea9f47e3bea]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:23:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:22 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb Aug 13 09:23:22 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:22 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb" returned: 0 in 0.619s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:22 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb Aug 13 09:23:22 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:22 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-5f10c249-87d6-4f0a-a566-81f353c5795e req-7a841595-409b-4e78-a6c7-105401c7d763 tempest-ServerActionsTestOtherA-1084879756 None] Terminate volume connection completed successfully. Aug 13 09:23:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-5f10c249-87d6-4f0a-a566-81f353c5795e req-7a841595-409b-4e78-a6c7-105401c7d763 tempest-ServerActionsTestOtherA-1084879756 None] Deleting attachment 1313871e-395e-4248-b426-fec8a0f0c877. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:23:23 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9fb0b9db-6930-4117-b8a9-6f13a96f94fb" returned: 0 in 0.520s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Lock "cinder-quobyte-9fb0b9db-6930-4117-b8a9-6f13a96f94fb" released by "delete_volume" :: held 1.236s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:23:23 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Created reservations ['f39a9f46-0154-478f-b98e-9336d1fceeba', '664c396a-e39a-45f4-82ef-b98dc3a90f6a', '1b41b876-4c3d-46de-a4b9-2f0ed030d7d4', '36658502-798e-4229-8d03-13eb42c939c8'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:23:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:23:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:23:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:23 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:23:23 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:24 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.490s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:24 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:23:24 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Deleted volume successfully. Aug 13 09:23:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e233f5e7-7460-4983-83cb-4c324bd25a13 tempest-ServersNegativeTestJSON-1367647236 None] Lock "cinder-9fb0b9db-6930-4117-b8a9-6f13a96f94fb-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:23:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-5f10c249-87d6-4f0a-a566-81f353c5795e req-6c8a8d95-0d1c-4e5e-a018-f0eb45856a7d tempest-ServerActionsTestOtherA-1084879756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-5f10c249-87d6-4f0a-a566-81f353c5795e req-6c8a8d95-0d1c-4e5e-a018-f0eb45856a7d tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:24 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b0231b-7df4-46f4-a4b4-313b8793a76d]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:23:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-5f10c249-87d6-4f0a-a566-81f353c5795e req-6c8a8d95-0d1c-4e5e-a018-f0eb45856a7d tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:24 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd Aug 13 09:23:24 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Acquiring lock "cinder-ea64a272-172f-4524-8c4d-fc735b3d517d-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:23:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Lock "cinder-ea64a272-172f-4524-8c4d-fc735b3d517d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:23:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Acquiring lock "cinder-quobyte-ea64a272-172f-4524-8c4d-fc735b3d517d" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:23:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Lock "cinder-quobyte-ea64a272-172f-4524-8c4d-fc735b3d517d" acquired by "delete_volume" :: waited 0.040s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:23:24 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf8a7ee-abc6-4df7-8f77-633332e19e4e]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:23:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ea64a272-172f-4524-8c4d-fc735b3d517d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:25 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-5f10c249-87d6-4f0a-a566-81f353c5795e req-6c8a8d95-0d1c-4e5e-a018-f0eb45856a7d tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd" returned: 0 in 0.732s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-5f10c249-87d6-4f0a-a566-81f353c5795e req-6c8a8d95-0d1c-4e5e-a018-f0eb45856a7d tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.759s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-5f10c249-87d6-4f0a-a566-81f353c5795e req-6c8a8d95-0d1c-4e5e-a018-f0eb45856a7d tempest-ServerActionsTestOtherA-1084879756 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-6e891031-859c-4885-80d1-195e50b5f7bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb1be6c2-8650-4109-b25b-a8f48dbaf4a4', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:23:25 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ea64a272-172f-4524-8c4d-fc735b3d517d Aug 13 09:23:25 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:25 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-5f10c249-87d6-4f0a-a566-81f353c5795e req-6c8a8d95-0d1c-4e5e-a018-f0eb45856a7d tempest-ServerActionsTestOtherA-1084879756 None] attachment_update completed successfully. Aug 13 09:23:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-e349222d-1fcd-44d9-81b3-3e16ed85cc29 req-3c1f2e09-3ad1-4a73-903b-805d6d09410f tempest-DeleteServersTestJSON-1317298536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-e349222d-1fcd-44d9-81b3-3e16ed85cc29 req-3c1f2e09-3ad1-4a73-903b-805d6d09410f tempest-DeleteServersTestJSON-1317298536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:25 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[72725fad-3c03-412c-974b-c2f22d25e317]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:23:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-e349222d-1fcd-44d9-81b3-3e16ed85cc29 req-3c1f2e09-3ad1-4a73-903b-805d6d09410f tempest-DeleteServersTestJSON-1317298536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-43621463-d507-4293-92b6-abe9a0457a36 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:25 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ea64a272-172f-4524-8c4d-fc735b3d517d" returned: 0 in 0.681s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ea64a272-172f-4524-8c4d-fc735b3d517d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:25 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-43621463-d507-4293-92b6-abe9a0457a36 Aug 13 09:23:25 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:25 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ea64a272-172f-4524-8c4d-fc735b3d517d Aug 13 09:23:25 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:26 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ea64a272-172f-4524-8c4d-fc735b3d517d" returned: 0 in 0.395s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Lock "cinder-quobyte-ea64a272-172f-4524-8c4d-fc735b3d517d" released by "delete_volume" :: held 1.193s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:23:26 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-e349222d-1fcd-44d9-81b3-3e16ed85cc29 req-3c1f2e09-3ad1-4a73-903b-805d6d09410f tempest-DeleteServersTestJSON-1317298536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-43621463-d507-4293-92b6-abe9a0457a36" returned: 0 in 0.668s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-e349222d-1fcd-44d9-81b3-3e16ed85cc29 req-3c1f2e09-3ad1-4a73-903b-805d6d09410f tempest-DeleteServersTestJSON-1317298536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.695s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-e349222d-1fcd-44d9-81b3-3e16ed85cc29 req-3c1f2e09-3ad1-4a73-903b-805d6d09410f tempest-DeleteServersTestJSON-1317298536 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-43621463-d507-4293-92b6-abe9a0457a36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77ac6107-1bb6-4c7f-a90d-9bc66e94ff75', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:23:26 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Created reservations ['d2ef8b66-1b72-4e87-8e51-996dc4cf75c6', '77449e2e-de89-43b6-acf1-df2351210144', '2cd57a6e-3d49-45f4-bfa2-6de9bee6d8b1', '4ccf693b-ef90-443f-95ce-f855bfc193fc'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:23:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:23:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:23:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-e349222d-1fcd-44d9-81b3-3e16ed85cc29 req-3c1f2e09-3ad1-4a73-903b-805d6d09410f tempest-DeleteServersTestJSON-1317298536 None] attachment_update completed successfully. Aug 13 09:23:26 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:23:26 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:27 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.605s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:27 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:23:27 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Deleted volume successfully. Aug 13 09:23:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6e030c02-e6fc-45c3-844a-bce3ae190ef1 tempest-ServersNegativeTestJSON-1367647236 None] Lock "cinder-ea64a272-172f-4524-8c4d-fc735b3d517d-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:23:32 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-c3062536-0255-4346-a73f-c355ee4b3d69 req-ecc0e412-abac-48bb-a89d-57721d5a76a6 tempest-DeleteServersTestJSON-1317298536 None] Terminate volume connection completed successfully. Aug 13 09:23:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-c3062536-0255-4346-a73f-c355ee4b3d69 req-ecc0e412-abac-48bb-a89d-57721d5a76a6 tempest-DeleteServersTestJSON-1317298536 None] Deleting attachment 77ac6107-1bb6-4c7f-a90d-9bc66e94ff75. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:23:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Acquiring lock "cinder-43621463-d507-4293-92b6-abe9a0457a36-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:23:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Lock "cinder-43621463-d507-4293-92b6-abe9a0457a36-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:23:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Acquiring lock "cinder-quobyte-43621463-d507-4293-92b6-abe9a0457a36" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:23:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Lock "cinder-quobyte-43621463-d507-4293-92b6-abe9a0457a36" acquired by "delete_volume" :: waited 0.023s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:23:34 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbefa336-a12a-4bcb-8e76-1812686cdd24]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:23:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-43621463-d507-4293-92b6-abe9a0457a36 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:34 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-43621463-d507-4293-92b6-abe9a0457a36 Aug 13 09:23:34 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:34 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-43621463-d507-4293-92b6-abe9a0457a36" returned: 0 in 0.539s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-43621463-d507-4293-92b6-abe9a0457a36 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:34 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-43621463-d507-4293-92b6-abe9a0457a36 Aug 13 09:23:34 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:34 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-43621463-d507-4293-92b6-abe9a0457a36" returned: 0 in 0.280s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Lock "cinder-quobyte-43621463-d507-4293-92b6-abe9a0457a36" released by "delete_volume" :: held 0.859s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:23:35 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Created reservations ['220cda2a-8077-483b-8d85-5899e4238056', 'e594cb34-787a-4732-9d71-7fc3b26be777', 'eab0b6bf-b040-4dd0-9a4f-01b8d12cdc63', 'a92e4cb5-22b2-4be2-98eb-6789773d84a3'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:23:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:23:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:23:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:35 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:23:35 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:35 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.426s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:35 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:23:35 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Deleted volume successfully. Aug 13 09:23:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1321ee85-146c-4949-9a0b-d76d3af24e52 tempest-DeleteServersTestJSON-1317298536 None] Lock "cinder-43621463-d507-4293-92b6-abe9a0457a36-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:23:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:23:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:23:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:23:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:43 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:23:43 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:43 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.438s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:23:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:23:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 8 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:23:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=46,cinder:UPDATE=46,cinder:INSERT=12,cinder:DELETE=3 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Flow 'volume_create_manager' (bbdfcf13-b522-4df4-baa4-22848729048a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d51894-e558-4917-a44a-7abf9770e004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d51894-e558-4917-a44a-7abf9770e004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2049815799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa8755d-ad82-4f48-be4a-e823599062e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c4e17ab5bb45d2b8a96498a45c317e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:23:45Z,use_quota=True,user_id='4e9cb6efa0a04c6c8602dc4eaa971441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62457b2f-268c-4174-a868-0bb614a0abc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62457b2f-268c-4174-a868-0bb614a0abc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824f1826-46df-44c3-856d-b7471cee749f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824f1826-46df-44c3-856d-b7471cee749f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa8755d-ad82-4f48-be4a-e823599062e5', 'volume_name': 'volume-0aa8755d-ad82-4f48-be4a-e823599062e5', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c766d47e-e443-4867-a99d-a9d7e301f5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c766d47e-e443-4867-a99d-a9d7e301f5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7f4e21-344b-4857-9df9-a3726a9bca29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:45 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Volume 0aa8755d-ad82-4f48-be4a-e823599062e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa8755d-ad82-4f48-be4a-e823599062e5', 'volume_size': 1} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2049815799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa8755d-ad82-4f48-be4a-e823599062e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c4e17ab5bb45d2b8a96498a45c317e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:23:45Z,use_quota=True,user_id='4e9cb6efa0a04c6c8602dc4eaa971441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Creating volume 0aa8755d-ad82-4f48-be4a-e823599062e5 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:23:45 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:45 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5 1073741824 Aug 13 09:23:45 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:45 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5 1073741824" returned: 0 in 0.591s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:45 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5 Aug 13 09:23:45 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:46 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5" returned: 0 in 0.272s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:46 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:23:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:46 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7f4e21-344b-4857-9df9-a3726a9bca29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa8755d-ad82-4f48-be4a-e823599062e5', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:46 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6668933f-e5c0-4270-942d-1b74f1f9a0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:23:46 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Volume volume-0aa8755d-ad82-4f48-be4a-e823599062e5 (0aa8755d-ad82-4f48-be4a-e823599062e5): created successfully Aug 13 09:23:46 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6668933f-e5c0-4270-942d-1b74f1f9a0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:23:46 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Flow 'volume_create_manager' (bbdfcf13-b522-4df4-baa4-22848729048a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:23:46 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-d023e9b0-fe8b-49b6-9270-ad1edb4d6670 req-39a8d5c1-329f-45f7-8856-02907ea09d9f tempest-VolumesSnapshotsTestJSON-251387602 None] Created volume successfully. Aug 13 09:23:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] Creating offline snapshot 22ca789f-d426-4893-8958-82361358563e of volume 0aa8755d-ad82-4f48-be4a-e823599062e5 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:23:47 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4660926-5deb-4740-8d99-978732a94ebf]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:23:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:47 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5 Aug 13 09:23:47 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:48 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5" returned: 0 in 0.491s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:48 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e 1G Aug 13 09:23:48 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:48 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e 1G" returned: 0 in 0.470s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aa8755d-ad82-4f48-be4a-e823599062e5 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:48 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aa8755d-ad82-4f48-be4a-e823599062e5 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e Aug 13 09:23:48 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:49 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aa8755d-ad82-4f48-be4a-e823599062e5 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e" returned: 0 in 0.337s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:49 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e is being set with open permissions: ugo+rw Aug 13 09:23:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:49 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e Aug 13 09:23:49 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:49 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e" returned: 0 in 0.286s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:49 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.info Aug 13 09:23:49 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:49 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.info" returned: 0 in 0.361s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:49 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.info is being set with open permissions: ugo+rw Aug 13 09:23:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:49 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.info Aug 13 09:23:49 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:50 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.info" returned: 0 in 0.282s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:50 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-28a51d33-2024-4a45-82f0-038277fbaeb3 req-e359bc7a-4d39-4a7e-86b5-d65d10d11137 tempest-VolumesSnapshotsTestJSON-251387602 None] Create snapshot completed successfully Aug 13 09:23:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Acquiring lock "cinder-22ca789f-d426-4893-8958-82361358563e-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:23:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "cinder-22ca789f-d426-4893-8958-82361358563e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:23:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Acquiring lock "cinder-quobyte-0aa8755d-ad82-4f48-be4a-e823599062e5" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:23:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "cinder-quobyte-0aa8755d-ad82-4f48-be4a-e823599062e5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:23:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Acquiring lock "cinder-quobyte-22ca789f-d426-4893-8958-82361358563e" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:23:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "cinder-quobyte-22ca789f-d426-4893-8958-82361358563e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:23:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Deleting offline snapshot 22ca789f-d426-4893-8958-82361358563e of volume 0aa8755d-ad82-4f48-be4a-e823599062e5 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:23:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] snapshot_file for this snap is: volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:23:50 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1449ec79-fe40-4a4b-b79e-e676843c1909]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:23:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:50 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e Aug 13 09:23:50 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:51 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e" returned: 0 in 0.511s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aa8755d-ad82-4f48-be4a-e823599062e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:23:51 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[856a8cb8-50da-4a74-8395-627333488172]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:23:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:51 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5 Aug 13 09:23:51 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:51 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5" returned: 0 in 0.499s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:51 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e Aug 13 09:23:51 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:52 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e" returned: 0 in 0.509s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:52 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e Aug 13 09:23:52 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:52 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5.22ca789f-d426-4893-8958-82361358563e" returned: 0 in 0.399s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:52 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "cinder-quobyte-22ca789f-d426-4893-8958-82361358563e" released by "_delete_snapshot" :: held 2.078s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:23:52 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "cinder-quobyte-0aa8755d-ad82-4f48-be4a-e823599062e5" released by "delete_snapshot" :: held 2.115s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:23:52 devstack cinder-volume[94670]: WARNING cinder.quota [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:23:52 devstack cinder-volume[94670]: DEBUG cinder.quota [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Created reservations ['eaa37ed3-b4da-44ad-ba44-05f36c83e5ec', 'baf18141-4527-459f-8970-d38b15b1495c', 'e5eead3f-cdc7-4310-af47-4eb161052389', '69fce6fd-2d84-41ee-ba55-3947cdd9c2a8'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:23:52 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Delete snapshot completed successfully. Aug 13 09:23:52 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-ec13d8be-4531-4fcd-b734-efcac6aedfd2 req-cf3bd2bb-b0dd-4b6b-a2e0-233653acd147 tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "cinder-22ca789f-d426-4893-8958-82361358563e-delete_snapshot" released by "delete_snapshot" :: held 2.452s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:23:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Acquiring lock "cinder-0aa8755d-ad82-4f48-be4a-e823599062e5-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:23:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "cinder-0aa8755d-ad82-4f48-be4a-e823599062e5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:23:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Acquiring lock "cinder-quobyte-0aa8755d-ad82-4f48-be4a-e823599062e5" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:23:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "cinder-quobyte-0aa8755d-ad82-4f48-be4a-e823599062e5" acquired by "delete_volume" :: waited 0.040s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:23:54 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00fdb58-bb7c-42e9-9f68-bfd904ab7354]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:23:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:54 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5 Aug 13 09:23:54 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:54 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5" returned: 0 in 0.480s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:54 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5 Aug 13 09:23:54 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:54 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0aa8755d-ad82-4f48-be4a-e823599062e5" returned: 0 in 0.354s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "cinder-quobyte-0aa8755d-ad82-4f48-be4a-e823599062e5" released by "delete_volume" :: held 0.915s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:23:55 devstack cinder-volume[94670]: DEBUG cinder.quota [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Created reservations ['81f2ec9c-d9bd-43ed-ab11-44f0756ca9e2', '1d75706c-ab89-47cf-99f7-f821444870fa', '9b99e95e-d624-4769-820f-5e5b329f5538', '37bc9283-d771-49b1-b875-2760e291a73b'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:23:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:23:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:23:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:23:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:23:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:23:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:23:55 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:23:55 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:23:55 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Aug 13 09:23:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.344s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:23:55 devstack cinder-volume[94670]: DEBUG cinder.manager [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:23:55 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Deleted volume successfully. Aug 13 09:23:55 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-5996847a-7506-4f3d-a43f-42728d0d9cd0 req-abd26592-4a38-47af-a922-952bd213c6fe tempest-VolumesSnapshotsTestJSON-251387602 None] Lock "cinder-0aa8755d-ad82-4f48-be4a-e823599062e5-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:23:59 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-a5d22987-5ed1-4e74-88b0-4dc438ba406a req-0de716b1-10e2-4ec5-97e4-f3e50ac00c66 tempest-ServerActionsTestOtherA-1084879756 None] Terminate volume connection completed successfully. Aug 13 09:23:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-a5d22987-5ed1-4e74-88b0-4dc438ba406a req-0de716b1-10e2-4ec5-97e4-f3e50ac00c66 tempest-ServerActionsTestOtherA-1084879756 None] Deleting attachment bb1be6c2-8650-4109-b25b-a8f48dbaf4a4. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:24:09 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=63,cinder:SELECT=65,cinder:INSERT=11,cinder:DELETE=5 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:24:09 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=12,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=6 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:24:09 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e5e8e3a7-c068-47e5-ad9c-78417a7b91b3 tempest-GroupsTest-815700223 None] Group tempest-Group1-1803790673: creating Aug 13 09:24:09 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:24:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Flow 'volume_create_manager' (d50aff5e-22a9-421f-998b-a7bdf176c898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:24:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f52141-d3ce-413c-82ff-2b55eab7e51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f52141-d3ce-413c-82ff-2b55eab7e51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1797379998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f2509e-30f6-4706-be8b-26bcb01890b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ed6d6ab3504b38874813a497d0407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:24:09Z,use_quota=True,user_id='a9056a04acd143adaf6084c703e56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8408d67f-a787-4aca-87d7-dbf0a193ed84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8408d67f-a787-4aca-87d7-dbf0a193ed84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b004cff0-0c8f-474a-be55-0eb8a76545a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:09 devstack cinder-volume[94670]: DEBUG cinder.image.glance [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Creating Keystone auth plugin from conf {{(pid=94670) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 13 09:24:09 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e5e8e3a7-c068-47e5-ad9c-78417a7b91b3 tempest-GroupsTest-815700223 None] Group tempest-Group1-1803790673: created successfully Aug 13 09:24:09 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e5e8e3a7-c068-47e5-ad9c-78417a7b91b3 tempest-GroupsTest-815700223 None] Create group completed successfully. Aug 13 09:24:10 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b004cff0-0c8f-474a-be55-0eb8a76545a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e0f2509e-30f6-4706-be8b-26bcb01890b1', 'volume_name': 'volume-e0f2509e-30f6-4706-be8b-26bcb01890b1', 'volume_size': 1, 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3c2349994ac4b0198f93975c909efdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'created_at': datetime.datetime(2026, 8, 13, 7, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 15, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1330bb5-9d27-4913-888d-485e4ed28bd9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:10 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14b846c-14b9-49a3-aeb9-e07ce0c806d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:10 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14b846c-14b9-49a3-aeb9-e07ce0c806d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:10 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a614f528-a41a-43fc-bfd8-f1c0229494cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:10 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Volume e0f2509e-30f6-4706-be8b-26bcb01890b1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e0f2509e-30f6-4706-be8b-26bcb01890b1', 'volume_size': 1, 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3c2349994ac4b0198f93975c909efdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'created_at': datetime.datetime(2026, 8, 13, 7, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 15, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1330bb5-9d27-4913-888d-485e4ed28bd9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 13 09:24:10 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Trying to clone e0f2509e-30f6-4706-be8b-26bcb01890b1 from image b1330bb5-9d27-4913-888d-485e4ed28bd9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]). {{(pid=94670) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 13 09:24:10 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_palqur4rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 13 09:24:10 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Image download 20.69 MB at 20.69 MB/s Aug 13 09:24:10 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3400d010-cae2-4aaa-b998-5394f2191283]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:24:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_palqur4rdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:11 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5c994946-7498-4df8-976b-48bc920a729d tempest-GroupsTest-815700223 None] Group tempest-Group2-1979075284: creating Aug 13 09:24:11 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5c994946-7498-4df8-976b-48bc920a729d tempest-GroupsTest-815700223 None] Group tempest-Group2-1979075284: created successfully Aug 13 09:24:11 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5c994946-7498-4df8-976b-48bc920a729d tempest-GroupsTest-815700223 None] Create group completed successfully. Aug 13 09:24:11 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_palqur4rdevstack@QuobyteHD Aug 13 09:24:11 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:11 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_palqur4rdevstack@QuobyteHD" returned: 0 in 0.719s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:11 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Temporary image b1330bb5-9d27-4913-888d-485e4ed28bd9 is fetched for user a9056a04acd143adaf6084c703e56eed. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 13 09:24:11 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4c7ab7-fd69-428b-b18e-6cc5abbd095c]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:24:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_palqur4rdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:12 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_palqur4rdevstack@QuobyteHD Aug 13 09:24:12 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:12 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_palqur4rdevstack@QuobyteHD" returned: 0 in 0.636s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1797379998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f2509e-30f6-4706-be8b-26bcb01890b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ed6d6ab3504b38874813a497d0407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:24:09Z,use_quota=True,user_id='a9056a04acd143adaf6084c703e56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:24:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Creating volume e0f2509e-30f6-4706-be8b-26bcb01890b1 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:24:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:24:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:24:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:24:12 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:24:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:12 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 1073741824 Aug 13 09:24:12 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:13 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:24:13 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Flow 'volume_create_manager' (71aaf628-17c0-4edb-a6c2-a4de08f09b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:24:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bd0742-3f1c-4bab-b9a3-251dc6da04d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 1073741824" returned: 0 in 0.996s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bd0742-3f1c-4bab-b9a3-251dc6da04d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-908022170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=464dc547-fc74-4e84-9574-98b9a187c464,host='devstack@QuobyteHD#QuobyteHD',id=d70b55a7-cd75-4eab-901a-a947c3566fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c23529c24c4aafb45f547fbb5713c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:24:13Z,use_quota=True,user_id='fa3f3bd332f64bd6b3417d6c5a50ecba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(029b5bc9-991a-4235-b2ed-a9da6dbc2fcc),volume_type_id=029b5bc9-991a-4235-b2ed-a9da6dbc2fcc)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce32f410-417d-4f0e-a40e-f979b063d4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce32f410-417d-4f0e-a40e-f979b063d4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8a2c14-5de9-4ce5-8435-e216f459e5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8a2c14-5de9-4ce5-8435-e216f459e5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd70b55a7-cd75-4eab-901a-a947c3566fab', 'volume_name': 'volume-d70b55a7-cd75-4eab-901a-a947c3566fab', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490ed71a-57bb-4252-8a43-1277f66f0866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490ed71a-57bb-4252-8a43-1277f66f0866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dac1ffd-a673-4097-ab48-0b1332035b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:13 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Volume d70b55a7-cd75-4eab-901a-a947c3566fab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d70b55a7-cd75-4eab-901a-a947c3566fab', 'volume_size': 1} Aug 13 09:24:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:13 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 Aug 13 09:24:13 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:13 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1" returned: 0 in 0.345s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.404s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=464dc547-fc74-4e84-9574-98b9a187c464,created_at=2026-08-13T07:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-908022170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=464dc547-fc74-4e84-9574-98b9a187c464,host='devstack@QuobyteHD#QuobyteHD',id=d70b55a7-cd75-4eab-901a-a947c3566fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c23529c24c4aafb45f547fbb5713c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:24:13Z,use_quota=True,user_id='fa3f3bd332f64bd6b3417d6c5a50ecba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(029b5bc9-991a-4235-b2ed-a9da6dbc2fcc),volume_type_id=029b5bc9-991a-4235-b2ed-a9da6dbc2fcc)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Creating volume d70b55a7-cd75-4eab-901a-a947c3566fab {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:24:14 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d70b55a7-cd75-4eab-901a-a947c3566fab 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:14 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d70b55a7-cd75-4eab-901a-a947c3566fab 1073741824 Aug 13 09:24:14 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Attempting download of b1330bb5-9d27-4913-888d-485e4ed28bd9 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}])) to volume e0f2509e-30f6-4706-be8b-26bcb01890b1. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b179530e-50f1-47c5-89c6-310bae40faab]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_ha16w1hn {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:14 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_ha16w1hn Aug 13 09:24:14 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:14 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_ha16w1hn" returned: 0 in 0.587s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_ha16w1hn {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:14 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d70b55a7-cd75-4eab-901a-a947c3566fab 1073741824" returned: 0 in 0.887s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d70b55a7-cd75-4eab-901a-a947c3566fab {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:15 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d70b55a7-cd75-4eab-901a-a947c3566fab Aug 13 09:24:15 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:15 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_ha16w1hn Aug 13 09:24:15 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:15 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d70b55a7-cd75-4eab-901a-a947c3566fab" returned: 0 in 0.274s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:24:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dac1ffd-a673-4097-ab48-0b1332035b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d70b55a7-cd75-4eab-901a-a947c3566fab', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37bb604-2368-4c5b-b9e4-7de530a61812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:15 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_ha16w1hn" returned: 1 in 0.435s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_ha16w1hn' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:24:15 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d34cd3c-b2f2-4389-950f-0e360c33628b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:24:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_palqur4rdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:15 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Volume volume-d70b55a7-cd75-4eab-901a-a947c3566fab (d70b55a7-cd75-4eab-901a-a947c3566fab): created successfully Aug 13 09:24:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37bb604-2368-4c5b-b9e4-7de530a61812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Flow 'volume_create_manager' (71aaf628-17c0-4edb-a6c2-a4de08f09b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:24:15 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-37aad618-8d49-4a4b-81f4-ec4c72809dde tempest-GroupsTest-815700223 None] Created volume successfully. Aug 13 09:24:15 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_palqur4rdevstack@QuobyteHD Aug 13 09:24:15 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:15 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_palqur4rdevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:15 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] b1330bb5-9d27-4913-888d-485e4ed28bd9 was qcow2, converting to raw {{(pid=94670) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 13 09:24:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_palqur4rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:15 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_palqur4rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 Aug 13 09:24:15 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:18 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Acquiring lock "cinder-quobyte-d70b55a7-cd75-4eab-901a-a947c3566fab" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:24:18 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Lock "cinder-quobyte-d70b55a7-cd75-4eab-901a-a947c3566fab" acquired by "delete_volume" :: waited 0.062s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:24:18 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa54a7d-b8e8-408a-bb74-46bd704b36b9]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:24:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d70b55a7-cd75-4eab-901a-a947c3566fab {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:18 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_palqur4rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1" returned: 0 in 2.913s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:18 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_palqur4rdevstack@QuobyteHD, size 112.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:24:18 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Converted 112.00 MB image at 38.43 MB/s Aug 13 09:24:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:18 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d70b55a7-cd75-4eab-901a-a947c3566fab Aug 13 09:24:18 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:18 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 1G Aug 13 09:24:18 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:19 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d70b55a7-cd75-4eab-901a-a947c3566fab" returned: 0 in 0.699s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d70b55a7-cd75-4eab-901a-a947c3566fab {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:19 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d70b55a7-cd75-4eab-901a-a947c3566fab Aug 13 09:24:19 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:19 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 1G" returned: 0 in 0.679s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:19 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0a3f8f-dc47-4c28-8bcf-f3aefbeda558]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:24:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:19 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 Aug 13 09:24:19 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:20 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d70b55a7-cd75-4eab-901a-a947c3566fab" returned: 0 in 0.836s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Lock "cinder-quobyte-d70b55a7-cd75-4eab-901a-a947c3566fab" released by "delete_volume" :: held 1.645s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:24:20 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Created reservations ['74a749dd-458c-4063-9d4b-2d24eef92ba2'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:24:20 devstack cinder-volume[94670]: WARNING cinder.quota [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1823323621 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1823323621, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:24:20 devstack cinder-volume[94670]: WARNING cinder.quota [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1823323621 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1823323621, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:24:20 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Created reservations ['c4d7022d-cad5-4ad1-bd48-49d35afa2956', '84cb85e8-bbb5-41ca-95a5-0321e582f267', '5301edfe-bcae-44f7-814b-ab8c06f7e6b8', 'a372f3bf-3e48-4508-b883-927f4c6c54ee'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:24:20 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1" returned: 0 in 0.962s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:24:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:24:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:20 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:24:20 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:20 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 Aug 13 09:24:20 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:21 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.608s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:21 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:24:21 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-4130fc7b-5029-4d4d-a756-ac7ad8dc8826 tempest-GroupsTest-815700223 None] Delete group completed successfully. Aug 13 09:24:21 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1" returned: 1 in 1.330s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:24:21 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Downloaded image b1330bb5-9d27-4913-888d-485e4ed28bd9 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}])) to volume e0f2509e-30f6-4706-be8b-26bcb01890b1 successfully. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 13 09:24:21 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Temporary image b1330bb5-9d27-4913-888d-485e4ed28bd9 for user a9056a04acd143adaf6084c703e56eed is deleted. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 13 09:24:21 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Marking volume e0f2509e-30f6-4706-be8b-26bcb01890b1 as bootable. {{(pid=94670) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 13 09:24:21 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Copying metadata from image b1330bb5-9d27-4913-888d-485e4ed28bd9 to e0f2509e-30f6-4706-be8b-26bcb01890b1. {{(pid=94670) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 13 09:24:21 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Creating volume glance metadata for volume e0f2509e-30f6-4706-be8b-26bcb01890b1 backed by image b1330bb5-9d27-4913-888d-485e4ed28bd9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94670) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 13 09:24:21 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-dd9d389e-4db3-4f2e-bbe6-9d7dcd2b5f92 tempest-GroupsTest-815700223 None] Created reservations ['23c69e2c-b242-4bdc-85c3-cd8eee798c57'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:24:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd9d389e-4db3-4f2e-bbe6-9d7dcd2b5f92 tempest-GroupsTest-815700223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd9d389e-4db3-4f2e-bbe6-9d7dcd2b5f92 tempest-GroupsTest-815700223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dd9d389e-4db3-4f2e-bbe6-9d7dcd2b5f92 tempest-GroupsTest-815700223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:24:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dd9d389e-4db3-4f2e-bbe6-9d7dcd2b5f92 tempest-GroupsTest-815700223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:24:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd9d389e-4db3-4f2e-bbe6-9d7dcd2b5f92 tempest-GroupsTest-815700223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd9d389e-4db3-4f2e-bbe6-9d7dcd2b5f92 tempest-GroupsTest-815700223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:22 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:24:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a614f528-a41a-43fc-bfd8-f1c0229494cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f2509e-30f6-4706-be8b-26bcb01890b1', 'volume_size': 1, 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3c2349994ac4b0198f93975c909efdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'created_at': datetime.datetime(2026, 8, 13, 7, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 15, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1330bb5-9d27-4913-888d-485e4ed28bd9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:22 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0295c1f9-54bd-4cc7-b05d-e053eecc6e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:22 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Volume volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 (e0f2509e-30f6-4706-be8b-26bcb01890b1): created successfully Aug 13 09:24:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0295c1f9-54bd-4cc7-b05d-e053eecc6e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Flow 'volume_create_manager' (d50aff5e-22a9-421f-998b-a7bdf176c898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:24:22 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-4c15df03-21e1-4635-938e-e049a0d21d16 tempest-ServerActionsTestOtherA-1084879756 None] Created volume successfully. Aug 13 09:24:22 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd9d389e-4db3-4f2e-bbe6-9d7dcd2b5f92 tempest-GroupsTest-815700223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.415s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:22 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-dd9d389e-4db3-4f2e-bbe6-9d7dcd2b5f92 tempest-GroupsTest-815700223 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:24:22 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-dd9d389e-4db3-4f2e-bbe6-9d7dcd2b5f92 tempest-GroupsTest-815700223 None] Delete group completed successfully. Aug 13 09:24:24 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-137f188b-40de-4131-a0ab-6057dffe6cef tempest-GroupsTest-815700223 None] Group tempest-GroupsTest-Group-1487001424: creating Aug 13 09:24:24 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-137f188b-40de-4131-a0ab-6057dffe6cef tempest-GroupsTest-815700223 None] Group tempest-GroupsTest-Group-1487001424: created successfully Aug 13 09:24:24 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-137f188b-40de-4131-a0ab-6057dffe6cef tempest-GroupsTest-815700223 None] Create group completed successfully. Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Flow 'volume_create_manager' (873c8936-1244-4bc7-8b97-c8615ecae0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1528238-751a-4e54-9e62-f639fc70882b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1528238-751a-4e54-9e62-f639fc70882b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-409021099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21f8e131-0819-4096-87d9-a44d4198a8e4,host='devstack@QuobyteHD#QuobyteHD',id=79e5ecba-9def-4080-8c9e-70e98eed13d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c23529c24c4aafb45f547fbb5713c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:24:26Z,use_quota=True,user_id='fa3f3bd332f64bd6b3417d6c5a50ecba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63f2dc23-b553-4113-8610-46096f6ebf2d),volume_type_id=63f2dc23-b553-4113-8610-46096f6ebf2d)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14dd56e-3118-4945-b827-7cdaa67b98d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14dd56e-3118-4945-b827-7cdaa67b98d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed504b4f-0b96-4c4b-a810-11fe8cebe2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed504b4f-0b96-4c4b-a810-11fe8cebe2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e5ecba-9def-4080-8c9e-70e98eed13d4', 'volume_name': 'volume-79e5ecba-9def-4080-8c9e-70e98eed13d4', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be76239d-af15-40b2-8080-47a6e992603f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be76239d-af15-40b2-8080-47a6e992603f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ef03d6-6882-4bd1-924c-dd7da8340599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:26 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Volume 79e5ecba-9def-4080-8c9e-70e98eed13d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e5ecba-9def-4080-8c9e-70e98eed13d4', 'volume_size': 1} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=21f8e131-0819-4096-87d9-a44d4198a8e4,created_at=2026-08-13T07:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-409021099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21f8e131-0819-4096-87d9-a44d4198a8e4,host='devstack@QuobyteHD#QuobyteHD',id=79e5ecba-9def-4080-8c9e-70e98eed13d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c23529c24c4aafb45f547fbb5713c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:24:26Z,use_quota=True,user_id='fa3f3bd332f64bd6b3417d6c5a50ecba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63f2dc23-b553-4113-8610-46096f6ebf2d),volume_type_id=63f2dc23-b553-4113-8610-46096f6ebf2d)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Creating volume 79e5ecba-9def-4080-8c9e-70e98eed13d4 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:24:26 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:24:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-79e5ecba-9def-4080-8c9e-70e98eed13d4 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:26 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-79e5ecba-9def-4080-8c9e-70e98eed13d4 1073741824 Aug 13 09:24:26 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:27 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-79e5ecba-9def-4080-8c9e-70e98eed13d4 1073741824" returned: 0 in 1.200s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-79e5ecba-9def-4080-8c9e-70e98eed13d4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:28 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-79e5ecba-9def-4080-8c9e-70e98eed13d4 Aug 13 09:24:28 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:28 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-79e5ecba-9def-4080-8c9e-70e98eed13d4" returned: 0 in 0.683s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:24:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ef03d6-6882-4bd1-924c-dd7da8340599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e5ecba-9def-4080-8c9e-70e98eed13d4', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b335c64a-9137-487c-8ede-ac6df31646ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:28 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Volume volume-79e5ecba-9def-4080-8c9e-70e98eed13d4 (79e5ecba-9def-4080-8c9e-70e98eed13d4): created successfully Aug 13 09:24:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b335c64a-9137-487c-8ede-ac6df31646ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Flow 'volume_create_manager' (873c8936-1244-4bc7-8b97-c8615ecae0dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:24:28 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-97ee704f-1c11-4d74-a822-0b8ed90fc5f5 tempest-GroupsTest-815700223 None] Created volume successfully. Aug 13 09:24:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-b803af3a-9740-4af2-ba66-b51c011ef28e req-6ea69dae-e0f1-40d6-a0c2-efb17ba12e7c tempest-ServerActionsTestOtherA-1084879756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-b803af3a-9740-4af2-ba66-b51c011ef28e req-6ea69dae-e0f1-40d6-a0c2-efb17ba12e7c tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:29 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbec255-4071-489a-9b17-76d28baa22da]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:24:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-b803af3a-9740-4af2-ba66-b51c011ef28e req-6ea69dae-e0f1-40d6-a0c2-efb17ba12e7c tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:29 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 Aug 13 09:24:29 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:29 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:24:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Flow 'volume_create_manager' (80967c73-6cbf-46ff-b2cf-8a6d010baef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:24:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b2d874-1ec3-4c36-ba7a-80d783b71157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b2d874-1ec3-4c36-ba7a-80d783b71157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-638458570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0180165e-a3ee-4e15-a360-cfe16d286094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3eba256751b4df8a50a6f5e010b53c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:24:30Z,use_quota=True,user_id='ecc26019e95941f4a74179d59ab6bd80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec80384-1f06-420e-959d-941a39caf23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec80384-1f06-420e-959d-941a39caf23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f402ea33-1265-4593-9c75-f4712948a0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f402ea33-1265-4593-9c75-f4712948a0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0180165e-a3ee-4e15-a360-cfe16d286094', 'volume_name': 'volume-0180165e-a3ee-4e15-a360-cfe16d286094', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e1463b-7c22-4323-8aa5-a95cdd2c82a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e1463b-7c22-4323-8aa5-a95cdd2c82a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37659b5-7a30-4463-a580-7dfca9ebd0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:30 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Volume 0180165e-a3ee-4e15-a360-cfe16d286094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0180165e-a3ee-4e15-a360-cfe16d286094', 'volume_size': 1} Aug 13 09:24:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:30 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-b803af3a-9740-4af2-ba66-b51c011ef28e req-6ea69dae-e0f1-40d6-a0c2-efb17ba12e7c tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1" returned: 0 in 0.763s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-b803af3a-9740-4af2-ba66-b51c011ef28e req-6ea69dae-e0f1-40d6-a0c2-efb17ba12e7c tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:30 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 Aug 13 09:24:30 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:24:31 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Flow 'volume_create_manager' (be31d9f8-4d1b-4056-93af-398eccbc9024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2248edfd-20e1-4782-bb23-e41f4a10348b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-b803af3a-9740-4af2-ba66-b51c011ef28e req-6ea69dae-e0f1-40d6-a0c2-efb17ba12e7c tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1" returned: 1 in 1.147s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-b803af3a-9740-4af2-ba66-b51c011ef28e req-6ea69dae-e0f1-40d6-a0c2-efb17ba12e7c tempest-ServerActionsTestOtherA-1084879756 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-b803af3a-9740-4af2-ba66-b51c011ef28e req-6ea69dae-e0f1-40d6-a0c2-efb17ba12e7c tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.014s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.194s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-638458570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0180165e-a3ee-4e15-a360-cfe16d286094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3eba256751b4df8a50a6f5e010b53c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:24:30Z,use_quota=True,user_id='ecc26019e95941f4a74179d59ab6bd80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Creating volume 0180165e-a3ee-4e15-a360-cfe16d286094 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:24:31 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0180165e-a3ee-4e15-a360-cfe16d286094 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2248edfd-20e1-4782-bb23-e41f4a10348b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1499470119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21f8e131-0819-4096-87d9-a44d4198a8e4,host='devstack@QuobyteHD#QuobyteHD',id=93745124-7027-49c0-9d45-d341d45a90a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c23529c24c4aafb45f547fbb5713c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:24:31Z,use_quota=True,user_id='fa3f3bd332f64bd6b3417d6c5a50ecba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63f2dc23-b553-4113-8610-46096f6ebf2d),volume_type_id=63f2dc23-b553-4113-8610-46096f6ebf2d)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69d4310-dba3-4750-8cb0-45a893d5f6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69d4310-dba3-4750-8cb0-45a893d5f6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0641dd21-a1db-4eda-a0a1-e128b0406400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:31 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0180165e-a3ee-4e15-a360-cfe16d286094 1073741824 Aug 13 09:24:31 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0641dd21-a1db-4eda-a0a1-e128b0406400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93745124-7027-49c0-9d45-d341d45a90a3', 'volume_name': 'volume-93745124-7027-49c0-9d45-d341d45a90a3', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77db4620-1b42-4bff-aa31-f7637aabfdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77db4620-1b42-4bff-aa31-f7637aabfdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f86ff3-90e1-4758-9ca7-74e5543cbc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:31 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Volume 93745124-7027-49c0-9d45-d341d45a90a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93745124-7027-49c0-9d45-d341d45a90a3', 'volume_size': 1} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-b803af3a-9740-4af2-ba66-b51c011ef28e req-6ea69dae-e0f1-40d6-a0c2-efb17ba12e7c tempest-ServerActionsTestOtherA-1084879756 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-e0f2509e-30f6-4706-be8b-26bcb01890b1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd793432-4ea3-4adf-bbf0-067a5a031ca4', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:24:31 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-b803af3a-9740-4af2-ba66-b51c011ef28e req-6ea69dae-e0f1-40d6-a0c2-efb17ba12e7c tempest-ServerActionsTestOtherA-1084879756 None] attachment_update completed successfully. Aug 13 09:24:32 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0180165e-a3ee-4e15-a360-cfe16d286094 1073741824" returned: 0 in 1.183s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0180165e-a3ee-4e15-a360-cfe16d286094 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:32 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0180165e-a3ee-4e15-a360-cfe16d286094 Aug 13 09:24:32 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:33 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0180165e-a3ee-4e15-a360-cfe16d286094" returned: 0 in 0.439s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.636s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=21f8e131-0819-4096-87d9-a44d4198a8e4,created_at=2026-08-13T07:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1499470119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21f8e131-0819-4096-87d9-a44d4198a8e4,host='devstack@QuobyteHD#QuobyteHD',id=93745124-7027-49c0-9d45-d341d45a90a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c23529c24c4aafb45f547fbb5713c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:24:31Z,use_quota=True,user_id='fa3f3bd332f64bd6b3417d6c5a50ecba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63f2dc23-b553-4113-8610-46096f6ebf2d),volume_type_id=63f2dc23-b553-4113-8610-46096f6ebf2d)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Creating volume 93745124-7027-49c0-9d45-d341d45a90a3 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:24:33 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-93745124-7027-49c0-9d45-d341d45a90a3 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37659b5-7a30-4463-a580-7dfca9ebd0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0180165e-a3ee-4e15-a360-cfe16d286094', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:33 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-93745124-7027-49c0-9d45-d341d45a90a3 1073741824 Aug 13 09:24:33 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab495bb-0b07-4206-af4b-3e8c6c466df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:33 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Volume volume-0180165e-a3ee-4e15-a360-cfe16d286094 (0180165e-a3ee-4e15-a360-cfe16d286094): created successfully Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab495bb-0b07-4206-af4b-3e8c6c466df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Flow 'volume_create_manager' (80967c73-6cbf-46ff-b2cf-8a6d010baef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:24:33 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-1d4336bf-4162-4ea8-9d4f-cd892746a434 tempest-ServerRescueNegativeTestJSON-1790483424 None] Created volume successfully. Aug 13 09:24:34 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-93745124-7027-49c0-9d45-d341d45a90a3 1073741824" returned: 0 in 1.369s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-93745124-7027-49c0-9d45-d341d45a90a3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:34 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-93745124-7027-49c0-9d45-d341d45a90a3 Aug 13 09:24:34 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:35 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-93745124-7027-49c0-9d45-d341d45a90a3" returned: 0 in 0.596s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:24:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f86ff3-90e1-4758-9ca7-74e5543cbc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93745124-7027-49c0-9d45-d341d45a90a3', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea76ca6e-ab20-41c2-a082-ec5eb0bfb9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:35 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Volume volume-93745124-7027-49c0-9d45-d341d45a90a3 (93745124-7027-49c0-9d45-d341d45a90a3): created successfully Aug 13 09:24:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea76ca6e-ab20-41c2-a082-ec5eb0bfb9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Flow 'volume_create_manager' (be31d9f8-4d1b-4056-93af-398eccbc9024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:24:35 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-ba8472e5-2492-4fed-bfee-1f3a0f12a340 tempest-GroupsTest-815700223 None] Created volume successfully. Aug 13 09:24:37 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-80cffe89-d9df-417e-96fc-e46629192f36 tempest-GroupsTest-815700223 None] Update group completed successfully. Aug 13 09:24:38 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3d366897-d627-41f4-8433-6a05f633ddf9 tempest-GroupsTest-815700223 None] Update group completed successfully. Aug 13 09:24:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Acquiring lock "cinder-quobyte-79e5ecba-9def-4080-8c9e-70e98eed13d4" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:24:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Lock "cinder-quobyte-79e5ecba-9def-4080-8c9e-70e98eed13d4" acquired by "delete_volume" :: waited 0.060s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:24:41 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[478c26b3-e65c-409a-aad4-dbd79f4af25d]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:24:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-79e5ecba-9def-4080-8c9e-70e98eed13d4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:41 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-79e5ecba-9def-4080-8c9e-70e98eed13d4 Aug 13 09:24:41 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:42 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-79e5ecba-9def-4080-8c9e-70e98eed13d4" returned: 0 in 1.147s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-79e5ecba-9def-4080-8c9e-70e98eed13d4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:42 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-79e5ecba-9def-4080-8c9e-70e98eed13d4 Aug 13 09:24:42 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:43 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-79e5ecba-9def-4080-8c9e-70e98eed13d4" returned: 0 in 0.525s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Lock "cinder-quobyte-79e5ecba-9def-4080-8c9e-70e98eed13d4" released by "delete_volume" :: held 1.790s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:24:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Acquiring lock "cinder-quobyte-93745124-7027-49c0-9d45-d341d45a90a3" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:24:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Lock "cinder-quobyte-93745124-7027-49c0-9d45-d341d45a90a3" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:24:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:24:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:24:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:24:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:43 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0468094-cfba-4a62-94fd-4fe7d6a3f0f3]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:24:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-93745124-7027-49c0-9d45-d341d45a90a3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:43 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:24:43 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:43 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-93745124-7027-49c0-9d45-d341d45a90a3 Aug 13 09:24:43 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:44 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.995s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:44 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:24:44 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:24:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:24:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:24:44 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-93745124-7027-49c0-9d45-d341d45a90a3" returned: 0 in 1.209s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-93745124-7027-49c0-9d45-d341d45a90a3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:44 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-93745124-7027-49c0-9d45-d341d45a90a3 Aug 13 09:24:44 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:44 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-93745124-7027-49c0-9d45-d341d45a90a3" returned: 0 in 0.382s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Lock "cinder-quobyte-93745124-7027-49c0-9d45-d341d45a90a3" released by "delete_volume" :: held 1.766s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:24:45 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Created reservations ['b5dd6df7-0ba9-4e16-9903-45ea0d4d9e00'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:24:45 devstack cinder-volume[94670]: WARNING cinder.quota [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-409835882 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-409835882, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:24:45 devstack cinder-volume[94670]: WARNING cinder.quota [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-409835882 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-409835882, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:24:45 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Created reservations ['dd1c5079-2dbb-4490-a875-6046477ad78c', 'd14b9536-11d6-4f7c-b84d-e316a1921540', '6d2c7966-6a6e-4702-bd7a-ef7ee2242ff8', 'cb1a8099-e887-445b-b97e-789686df3e62'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:24:45 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Created reservations ['1dd4e332-5a8e-418b-bdbc-1df3581bc950', 'f4c943ed-fd49-4a6f-ad20-c99f48e57978', '32bc05a5-9953-4b38-a220-e86294881319', 'ed06e9b8-6416-424b-9693-df0a09c9fded'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:24:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:24:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:24:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:45 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:24:45 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:46 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.453s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:46 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:24:46 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d66043f5-a175-4cce-a817-744bf1b22595 tempest-GroupsTest-815700223 None] Delete group completed successfully. Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Flow 'volume_create_manager' (f5c36683-d9d2-40b8-afeb-4b5574278afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec928998-80a8-4a37-86dc-794f910b62a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec928998-80a8-4a37-86dc-794f910b62a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-564578058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d53a529-fab6-4e64-8cde-8aa47163c4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a68c124c1b4515b6f68df7745dcbe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:24:50Z,use_quota=True,user_id='b6763ccfea1049b7b966d9ab6a627326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388a6ef3-99d9-4272-b1c2-4f4198018c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388a6ef3-99d9-4272-b1c2-4f4198018c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc87c1a1-2122-4635-b471-678bfddcd26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc87c1a1-2122-4635-b471-678bfddcd26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d53a529-fab6-4e64-8cde-8aa47163c4e5', 'volume_name': 'volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff364019-a3d5-49af-9337-0c3031010659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff364019-a3d5-49af-9337-0c3031010659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839158b2-e39d-4058-bbc2-d76f8d9baf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:50 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Volume 4d53a529-fab6-4e64-8cde-8aa47163c4e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5', 'volume_size': 1} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-564578058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d53a529-fab6-4e64-8cde-8aa47163c4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a68c124c1b4515b6f68df7745dcbe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:24:50Z,use_quota=True,user_id='b6763ccfea1049b7b966d9ab6a627326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Creating volume 4d53a529-fab6-4e64-8cde-8aa47163c4e5 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:24:50 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:24:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:50 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5 1073741824 Aug 13 09:24:50 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:51 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5 1073741824" returned: 0 in 1.034s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:51 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5 Aug 13 09:24:51 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:52 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5" returned: 0 in 0.697s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:24:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839158b2-e39d-4058-bbc2-d76f8d9baf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb1dd67-3cfe-4cb4-8b1f-7277f821d513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:24:52 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Volume volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5 (4d53a529-fab6-4e64-8cde-8aa47163c4e5): created successfully Aug 13 09:24:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb1dd67-3cfe-4cb4-8b1f-7277f821d513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:24:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Flow 'volume_create_manager' (f5c36683-d9d2-40b8-afeb-4b5574278afc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:24:52 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-dddc625c-101a-4bd2-b24c-b9fbf8790087 tempest-AttachVolumeShelveTestJSON-331936031 None] Created volume successfully. Aug 13 09:24:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Acquiring lock "cinder-0180165e-a3ee-4e15-a360-cfe16d286094-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:24:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Lock "cinder-0180165e-a3ee-4e15-a360-cfe16d286094-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:24:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Acquiring lock "cinder-quobyte-0180165e-a3ee-4e15-a360-cfe16d286094" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:24:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Lock "cinder-quobyte-0180165e-a3ee-4e15-a360-cfe16d286094" acquired by "delete_volume" :: waited 0.044s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:24:53 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f044dd-b66d-4092-9549-e4956ccf4474]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:24:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0180165e-a3ee-4e15-a360-cfe16d286094 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:53 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0180165e-a3ee-4e15-a360-cfe16d286094 Aug 13 09:24:53 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:54 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0180165e-a3ee-4e15-a360-cfe16d286094" returned: 0 in 1.139s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0180165e-a3ee-4e15-a360-cfe16d286094 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:54 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0180165e-a3ee-4e15-a360-cfe16d286094 Aug 13 09:24:54 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:55 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0180165e-a3ee-4e15-a360-cfe16d286094" returned: 0 in 0.723s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:55 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Lock "cinder-quobyte-0180165e-a3ee-4e15-a360-cfe16d286094" released by "delete_volume" :: held 1.956s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:24:55 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Created reservations ['cb2f354b-527c-4f2a-8ffa-84b2d8e3ad7f', 'b9b4cbce-0161-4026-b2f0-4c58a8ec2dd5', '7df79c75-c0b4-475a-836e-fdc92de3cfb8', '2eaa1ee2-a2b4-4888-8d68-3f455143efef'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:24:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:24:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:24:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:24:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:24:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:24:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:24:55 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:24:55 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:24:56 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Aug 13 09:24:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.789s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:24:56 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:24:56 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Deleted volume successfully. Aug 13 09:24:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8ef1c8cf-5de7-4fcd-ac03-93c37e051ef6 tempest-ServerRescueNegativeTestJSON-1790483424 None] Lock "cinder-0180165e-a3ee-4e15-a360-cfe16d286094-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:24:59 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-d8d85e2b-56e4-46df-aeed-fcc0c8dfc800 req-7df3c73f-c549-4f41-9a4f-586e8cb32bfd tempest-ServerActionsTestOtherA-1084879756 None] Terminate volume connection completed successfully. Aug 13 09:24:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d8d85e2b-56e4-46df-aeed-fcc0c8dfc800 req-7df3c73f-c549-4f41-9a4f-586e8cb32bfd tempest-ServerActionsTestOtherA-1084879756 None] Deleting attachment fd793432-4ea3-4adf-bbf0-067a5a031ca4. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:25:00 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-476bade8-ffe3-4ab4-9c85-283404b151cb tempest-GroupsV314Test-1372482223 None] Group tempest-GroupsV314Test-Group-73895689: creating Aug 13 09:25:00 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-476bade8-ffe3-4ab4-9c85-283404b151cb tempest-GroupsV314Test-1372482223 None] Group tempest-GroupsV314Test-Group-73895689: created successfully Aug 13 09:25:00 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-476bade8-ffe3-4ab4-9c85-283404b151cb tempest-GroupsV314Test-1372482223 None] Create group completed successfully. Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Flow 'volume_create_manager' (e5e26205-ae81-49aa-9ce8-9a54cbf63028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3b2249-62a5-438b-981f-dcb94a2d2808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3b2249-62a5-438b-981f-dcb94a2d2808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2016853434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19339468-a113-4e24-bc83-d7acd6c2b918,host='devstack@QuobyteHD#QuobyteHD',id=90d068b1-3d98-44c3-9a14-6f8a4ab9dffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298ebd895e40411cb37f54577586de44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:25:03Z,use_quota=True,user_id='058ac8bca378405296b9829a988541c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf726b45-6219-45a0-a13e-c2d112a54faf),volume_type_id=cf726b45-6219-45a0-a13e-c2d112a54faf)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1250ad80-c33e-4001-bf74-8d0a26483679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1250ad80-c33e-4001-bf74-8d0a26483679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f404810b-0e74-499b-a2c1-610d4bc1cccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f404810b-0e74-499b-a2c1-610d4bc1cccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d068b1-3d98-44c3-9a14-6f8a4ab9dffa', 'volume_name': 'volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f201fcf-2c09-4e45-b8ec-1d138a460d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f201fcf-2c09-4e45-b8ec-1d138a460d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7634ef64-4abd-49e7-9e37-1aee293f9d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:25:03 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Volume 90d068b1-3d98-44c3-9a14-6f8a4ab9dffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa', 'volume_size': 1} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=19339468-a113-4e24-bc83-d7acd6c2b918,created_at=2026-08-13T07:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2016853434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19339468-a113-4e24-bc83-d7acd6c2b918,host='devstack@QuobyteHD#QuobyteHD',id=90d068b1-3d98-44c3-9a14-6f8a4ab9dffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298ebd895e40411cb37f54577586de44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:25:03Z,use_quota=True,user_id='058ac8bca378405296b9829a988541c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf726b45-6219-45a0-a13e-c2d112a54faf),volume_type_id=cf726b45-6219-45a0-a13e-c2d112a54faf)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Creating volume 90d068b1-3d98-44c3-9a14-6f8a4ab9dffa {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:25:03 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:03 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa 1073741824 Aug 13 09:25:03 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-d8d85e2b-56e4-46df-aeed-fcc0c8dfc800 req-2b8a2cf4-b805-4731-9d83-4dbb4c706c63 tempest-ServerActionsTestOtherA-1084879756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:25:04 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa 1073741824" returned: 0 in 1.008s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:04 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa Aug 13 09:25:04 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:04 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa" returned: 0 in 0.497s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:25:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:25:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-d8d85e2b-56e4-46df-aeed-fcc0c8dfc800 req-2b8a2cf4-b805-4731-9d83-4dbb4c706c63 tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.977s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:25:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7634ef64-4abd-49e7-9e37-1aee293f9d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:25:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84e4658-c1b9-40e5-9f06-bdd8358575cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:25:04 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59883b3-a57b-4d84-b12d-cbf5e584e9ed]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:25:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-d8d85e2b-56e4-46df-aeed-fcc0c8dfc800 req-2b8a2cf4-b805-4731-9d83-4dbb4c706c63 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:04 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Volume volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa (90d068b1-3d98-44c3-9a14-6f8a4ab9dffa): created successfully Aug 13 09:25:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84e4658-c1b9-40e5-9f06-bdd8358575cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:25:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Flow 'volume_create_manager' (e5e26205-ae81-49aa-9ce8-9a54cbf63028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:25:04 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-50cda898-448d-401f-ab54-d5f9b1e4eb1b tempest-GroupsV314Test-1372482223 None] Created volume successfully. Aug 13 09:25:04 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 Aug 13 09:25:04 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:05 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-d8d85e2b-56e4-46df-aeed-fcc0c8dfc800 req-2b8a2cf4-b805-4731-9d83-4dbb4c706c63 tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1" returned: 0 in 0.516s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-d8d85e2b-56e4-46df-aeed-fcc0c8dfc800 req-2b8a2cf4-b805-4731-9d83-4dbb4c706c63 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:05 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 Aug 13 09:25:05 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:05 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-d8d85e2b-56e4-46df-aeed-fcc0c8dfc800 req-2b8a2cf4-b805-4731-9d83-4dbb4c706c63 tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1" returned: 1 in 0.523s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-d8d85e2b-56e4-46df-aeed-fcc0c8dfc800 req-2b8a2cf4-b805-4731-9d83-4dbb4c706c63 tempest-ServerActionsTestOtherA-1084879756 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:25:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-d8d85e2b-56e4-46df-aeed-fcc0c8dfc800 req-2b8a2cf4-b805-4731-9d83-4dbb4c706c63 tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.117s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:25:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d8d85e2b-56e4-46df-aeed-fcc0c8dfc800 req-2b8a2cf4-b805-4731-9d83-4dbb4c706c63 tempest-ServerActionsTestOtherA-1084879756 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-e0f2509e-30f6-4706-be8b-26bcb01890b1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d3efda5-a309-4968-92bb-3b24379d765c', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:25:06 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-d8d85e2b-56e4-46df-aeed-fcc0c8dfc800 req-2b8a2cf4-b805-4731-9d83-4dbb4c706c63 tempest-ServerActionsTestOtherA-1084879756 None] attachment_update completed successfully. Aug 13 09:25:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:25:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:25:06 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Cloning volume 90d068b1-3d98-44c3-9a14-6f8a4ab9dffa to volume 7722b531-7149-4b91-bafc-00b4bb84d1ef Aug 13 09:25:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Creating offline snapshot 094d0bde-614c-44e7-b79d-129df9ac1aa0 of volume 90d068b1-3d98-44c3-9a14-6f8a4ab9dffa {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:25:06 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[426144bd-1922-4744-a5a6-69827dcc2242]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:25:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:06 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa Aug 13 09:25:06 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:07 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa" returned: 0 in 0.655s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:07 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 1G Aug 13 09:25:07 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:07 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 1G" returned: 0 in 0.611s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:07 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 Aug 13 09:25:07 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:08 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0" returned: 0 in 0.607s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:08 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 is being set with open permissions: ugo+rw: NotImplementedError Aug 13 09:25:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:08 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 Aug 13 09:25:08 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:09 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0" returned: 0 in 0.592s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:09 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.info Aug 13 09:25:09 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:09 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.info" returned: 0 in 0.440s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:09 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.info is being set with open permissions: ugo+rw: NotImplementedError Aug 13 09:25:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:09 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.info Aug 13 09:25:09 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:09 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.info" returned: 0 in 0.424s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Acquiring lock "cinder-quobyte-7722b531-7149-4b91-bafc-00b4bb84d1ef" by "_copy_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Lock "cinder-quobyte-7722b531-7149-4b91-bafc-00b4bb84d1ef" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] snapshot: 094d0bde-614c-44e7-b79d-129df9ac1aa0, volume: 7722b531-7149-4b91-bafc-00b4bb84d1ef, {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13e19a6-b274-475f-938c-01e4fcfcc479]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:10 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 Aug 13 09:25:10 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:10 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0" returned: 0 in 0.640s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Creating direct copy from snapshot {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b9a836-46a1-40bc-afa9-9a28bde53fc1]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:25:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:10 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa Aug 13 09:25:10 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:11 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa" returned: 0 in 0.481s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:11 devstack cinder-volume[94670]: DEBUG cinder.utils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Path /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7722b531-7149-4b91-bafc-00b4bb84d1ef not found in is_blk_device check {{(pid=94670) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 13 09:25:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7722b531-7149-4b91-bafc-00b4bb84d1ef {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:11 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7722b531-7149-4b91-bafc-00b4bb84d1ef Aug 13 09:25:11 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:11 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=81,cinder:UPDATE=77,cinder:INSERT=22,cinder:DELETE=5 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:25:11 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=83,cinder:UPDATE=67,cinder:INSERT=19,cinder:DELETE=3 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:25:11 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-15a7fe14-f059-4826-bf06-30e5da08c51b req-e9a2ed89-bae6-47f2-8c32-82fd7fb89fb1 tempest-AttachVolumeShelveTestJSON-331936031 None] No connector for attachment 66ce8ba1-7bab-4090-af8c-d0a76fb30ecc; skipping storage backend terminate_connection call. {{(pid=94670) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 13 09:25:11 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-15a7fe14-f059-4826-bf06-30e5da08c51b req-e9a2ed89-bae6-47f2-8c32-82fd7fb89fb1 tempest-AttachVolumeShelveTestJSON-331936031 None] Deleting attachment 66ce8ba1-7bab-4090-af8c-d0a76fb30ecc. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:25:13 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-a32215c1-f019-4f9b-974d-732e5f66f8f9 tempest-ServerActionsTestOtherA-1084879756 None] Terminate volume connection completed successfully. Aug 13 09:25:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-a32215c1-f019-4f9b-974d-732e5f66f8f9 tempest-ServerActionsTestOtherA-1084879756 None] Deleting attachment 7d3efda5-a309-4968-92bb-3b24379d765c. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:25:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Acquiring lock "cinder-e0f2509e-30f6-4706-be8b-26bcb01890b1-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:25:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Lock "cinder-e0f2509e-30f6-4706-be8b-26bcb01890b1-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:25:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Acquiring lock "cinder-quobyte-e0f2509e-30f6-4706-be8b-26bcb01890b1" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:25:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Lock "cinder-quobyte-e0f2509e-30f6-4706-be8b-26bcb01890b1" acquired by "delete_volume" :: waited 0.040s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:25:14 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d290e7b2-ba75-420d-815c-32876b163542]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:25:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:15 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 Aug 13 09:25:15 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:15 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1" returned: 0 in 1.001s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:16 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 Aug 13 09:25:16 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Acquiring lock "cinder-6e891031-859c-4885-80d1-195e50b5f7bd-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:25:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Lock "cinder-6e891031-859c-4885-80d1-195e50b5f7bd-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:25:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Acquiring lock "cinder-quobyte-6e891031-859c-4885-80d1-195e50b5f7bd" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:25:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Lock "cinder-quobyte-6e891031-859c-4885-80d1-195e50b5f7bd" acquired by "delete_volume" :: waited 0.037s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:25:16 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1" returned: 1 in 0.939s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:25:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:16 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09e4177-2121-43cc-885a-834b3227f140]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:25:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:16 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1 Aug 13 09:25:16 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:17 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd Aug 13 09:25:17 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:17 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e0f2509e-30f6-4706-be8b-26bcb01890b1" returned: 0 in 0.991s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Lock "cinder-quobyte-e0f2509e-30f6-4706-be8b-26bcb01890b1" released by "delete_volume" :: held 3.134s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG cinder.quota [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Created reservations ['ef7913ae-aae6-421a-8130-1d66fbabba98', 'b96be07a-dea8-49dd-8d6a-1cba2cc1be02', 'b29d9d21-6b45-4e88-84be-9b5165bb256e', 'c83131ed-15be-4342-92fa-ca7075b00c6f'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:25:18 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd" returned: 0 in 1.212s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:25:18 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd Aug 13 09:25:18 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:18 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:25:18 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:18 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7722b531-7149-4b91-bafc-00b4bb84d1ef" returned: 0 in 7.075s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fd538f-a00b-4ea3-9ac0-604c94d95955]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:18 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa Aug 13 09:25:18 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:18 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.358s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG cinder.manager [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:25:18 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Deleted volume successfully. Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-7d9585b9-0022-4184-b53e-8a5c8db2b793 req-7cde866d-916b-4491-9106-835d0109c7ad tempest-ServerActionsTestOtherA-1084879756 None] Lock "cinder-e0f2509e-30f6-4706-be8b-26bcb01890b1-delete_volume" released by "delete_volume" :: held 4.040s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:25:18 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6e891031-859c-4885-80d1-195e50b5f7bd" returned: 0 in 0.519s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Lock "cinder-quobyte-6e891031-859c-4885-80d1-195e50b5f7bd" released by "delete_volume" :: held 1.857s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Created reservations ['226e2dd3-9c27-46d4-b462-378548a2c74e', '85274a35-dc3e-407d-885b-60daee1c2510', '70395c0e-7a8a-4ae9-a8be-9a1a03be3424', '8d22425a-10b4-46c3-b472-eb384fc9d8fd'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:25:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:18 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:25:18 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:19 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.371s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:19 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:25:19 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Deleted volume successfully. Aug 13 09:25:19 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa" returned: 0 in 0.967s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:19 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Image conversion details: src /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa, size 1024.00 MB, duration 7.08 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7722b531-7149-4b91-bafc-00b4bb84d1ef {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:25:19 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Converted 1024.00 MB image at 144.70 MB/s Aug 13 09:25:19 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7722b531-7149-4b91-bafc-00b4bb84d1ef is being set with open permissions: ugo+rw: NotImplementedError Aug 13 09:25:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7722b531-7149-4b91-bafc-00b4bb84d1ef {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-20bbefb9-f59a-459e-a2f5-3e7972ff9112 tempest-ServerActionsTestOtherA-1084879756 None] Lock "cinder-6e891031-859c-4885-80d1-195e50b5f7bd-delete_volume" released by "delete_volume" :: held 2.714s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:25:19 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7722b531-7149-4b91-bafc-00b4bb84d1ef Aug 13 09:25:19 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:19 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7722b531-7149-4b91-bafc-00b4bb84d1ef" returned: 0 in 0.379s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Lock "cinder-quobyte-7722b531-7149-4b91-bafc-00b4bb84d1ef" released by "_copy_volume_from_snapshot" :: held 9.701s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:25:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Acquiring lock "cinder-quobyte-094d0bde-614c-44e7-b79d-129df9ac1aa0" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:25:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Lock "cinder-quobyte-094d0bde-614c-44e7-b79d-129df9ac1aa0" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:25:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Deleting offline snapshot 094d0bde-614c-44e7-b79d-129df9ac1aa0 of volume 90d068b1-3d98-44c3-9a14-6f8a4ab9dffa {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:25:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] snapshot_file for this snap is: volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:25:19 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c801393-61cf-4b8d-a650-d03daad4222f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:25:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:20 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 Aug 13 09:25:20 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:20 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0" returned: 0 in 0.593s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:25:20 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d860c4a-2130-47b9-8aa6-0cf0cc559bfe]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:25:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:20 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa Aug 13 09:25:20 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:21 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa" returned: 0 in 0.594s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:21 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 Aug 13 09:25:21 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:21 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0" returned: 0 in 0.446s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:21 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0 Aug 13 09:25:21 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:21 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa.094d0bde-614c-44e7-b79d-129df9ac1aa0" returned: 0 in 0.363s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Lock "cinder-quobyte-094d0bde-614c-44e7-b79d-129df9ac1aa0" released by "_delete_snapshot" :: held 2.155s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:25:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.501s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:25:22 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c4500b68-5db0-4b72-9716-f65664455fe4 tempest-GroupsV314Test-1372482223 None] Create group from source-group-19339468-a113-4e24-bc83-d7acd6c2b918 completed successfully. Aug 13 09:25:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Acquiring lock "cinder-quobyte-7722b531-7149-4b91-bafc-00b4bb84d1ef" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:25:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Lock "cinder-quobyte-7722b531-7149-4b91-bafc-00b4bb84d1ef" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:25:23 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[14392808-30c1-42cf-a57d-0fcf3b6ef818]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:25:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7722b531-7149-4b91-bafc-00b4bb84d1ef {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:23 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7722b531-7149-4b91-bafc-00b4bb84d1ef Aug 13 09:25:23 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:23 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7722b531-7149-4b91-bafc-00b4bb84d1ef" returned: 0 in 0.414s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7722b531-7149-4b91-bafc-00b4bb84d1ef {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:23 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7722b531-7149-4b91-bafc-00b4bb84d1ef Aug 13 09:25:23 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:24 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7722b531-7149-4b91-bafc-00b4bb84d1ef" returned: 0 in 0.398s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Lock "cinder-quobyte-7722b531-7149-4b91-bafc-00b4bb84d1ef" released by "delete_volume" :: held 0.907s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:25:24 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Created reservations ['c7cac0a6-e9b9-4d74-ba4d-f9b5fcb0fabc'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:25:24 devstack cinder-volume[94670]: WARNING cinder.quota [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1620977023 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1620977023, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:25:24 devstack cinder-volume[94670]: WARNING cinder.quota [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1620977023 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1620977023, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:25:24 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Created reservations ['f3481bd9-af8e-4093-8988-2270fcffeb21', '5159a2b1-8380-4481-9626-250d55a8a7dd', '943bccc3-5864-49c4-9848-caa4e8aa73e0', 'a3f732f1-4b9b-4241-8503-57e359e4e837'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:25:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:25:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:25:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:25:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:25:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:25:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:24 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:25:24 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:24 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.348s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:24 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:25:24 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b9910810-b594-48fa-a677-22b8d3142224 tempest-GroupsV314Test-1372482223 None] Delete group completed successfully. Aug 13 09:25:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] Acquiring lock "cinder-quobyte-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:25:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] Lock "cinder-quobyte-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa" acquired by "delete_volume" :: waited 0.023s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:25:26 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbfdf54-b949-4bcc-9ff4-9b75b8ff1555]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:25:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:26 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa Aug 13 09:25:26 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:26 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa" returned: 0 in 0.411s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:26 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa Aug 13 09:25:26 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:26 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa" returned: 0 in 0.369s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] Lock "cinder-quobyte-90d068b1-3d98-44c3-9a14-6f8a4ab9dffa" released by "delete_volume" :: held 0.920s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:25:27 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] Created reservations ['c8fc2b61-4e89-4a85-8332-777659e68b17'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:25:27 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] Created reservations ['019ee698-cb60-4b0a-823b-73f2159d3868', '7efd1ab9-2862-4446-a8bb-8b1d55e0b6c6', '7543fd75-838f-4db5-af79-abe60649d905', '502cf694-c595-41b2-9f15-80bd4c3298d7'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:25:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:25:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:25:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:25:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:25:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:25:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:27 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:25:27 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:27 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.279s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:27 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:25:27 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5345bd53-d91f-4943-a45a-08d1c47f5223 tempest-GroupsV314Test-1372482223 None] Delete group completed successfully. Aug 13 09:25:37 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=31,cinder:UPDATE=39,cinder:INSERT=10 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:25:37 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=27,cinder:UPDATE=42,cinder:INSERT=8,cinder:DELETE=2 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Flow 'volume_create_manager' (ea5350a2-b535-45ad-a825-c96576bffa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0586c085-8151-47a5-9ee6-5d2c9c17a8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0586c085-8151-47a5-9ee6-5d2c9c17a8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-516067143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e30c745-d9f9-43d1-b321-737b4c2b2e33,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d872fce99d524c429a31a804edc69a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:25:39Z,use_quota=True,user_id='13c3a6c95fad4a5fac7a1fb7d031ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e41160-fe5e-46d8-88f3-4e17f6745b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e41160-fe5e-46d8-88f3-4e17f6745b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daeee67c-04b1-4560-b079-807ac1a47d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daeee67c-04b1-4560-b079-807ac1a47d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e30c745-d9f9-43d1-b321-737b4c2b2e33', 'volume_name': 'volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c39ee9-30d3-4309-9ae4-99ef82226a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c39ee9-30d3-4309-9ae4-99ef82226a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4393cd96-0f5c-41c0-863a-f48dce99fa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:25:39 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Volume 9e30c745-d9f9-43d1-b321-737b4c2b2e33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33', 'volume_size': 1} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-516067143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e30c745-d9f9-43d1-b321-737b4c2b2e33,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d872fce99d524c429a31a804edc69a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:25:39Z,use_quota=True,user_id='13c3a6c95fad4a5fac7a1fb7d031ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Creating volume 9e30c745-d9f9-43d1-b321-737b4c2b2e33 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:25:39 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:25:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:39 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33 1073741824 Aug 13 09:25:39 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:40 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33 1073741824" returned: 0 in 0.713s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:40 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33 Aug 13 09:25:40 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:40 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33" returned: 0 in 0.312s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:25:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:25:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4393cd96-0f5c-41c0-863a-f48dce99fa56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:25:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59570a2b-1237-477b-946f-0d78ae131bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:25:40 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Volume volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33 (9e30c745-d9f9-43d1-b321-737b4c2b2e33): created successfully Aug 13 09:25:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59570a2b-1237-477b-946f-0d78ae131bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:25:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Flow 'volume_create_manager' (ea5350a2-b535-45ad-a825-c96576bffa54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:25:40 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-730819f1-1c59-44ba-a162-19395ef6c6bb req-e0247997-d141-4f18-b6e5-3b321924c6fc tempest-VolumesGetTestJSON-589355167 None] Created volume successfully. Aug 13 09:25:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Acquiring lock "cinder-9e30c745-d9f9-43d1-b321-737b4c2b2e33-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:25:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Lock "cinder-9e30c745-d9f9-43d1-b321-737b4c2b2e33-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:25:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Acquiring lock "cinder-quobyte-9e30c745-d9f9-43d1-b321-737b4c2b2e33" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:25:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Lock "cinder-quobyte-9e30c745-d9f9-43d1-b321-737b4c2b2e33" acquired by "delete_volume" :: waited 0.032s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:25:42 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6684a9-813a-4df8-ac33-c2b3752401ca]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:25:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:42 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33 Aug 13 09:25:42 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:42 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33" returned: 0 in 0.578s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:42 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33 Aug 13 09:25:42 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:25:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:25:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:25:43 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9e30c745-d9f9-43d1-b321-737b4c2b2e33" returned: 0 in 0.419s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Lock "cinder-quobyte-9e30c745-d9f9-43d1-b321-737b4c2b2e33" released by "delete_volume" :: held 1.076s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:25:43 devstack cinder-volume[94670]: DEBUG cinder.quota [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Created reservations ['24c5aa31-4170-4e6a-9735-14c08a4237b7', 'bac3cfc0-a7f0-4160-87db-588cca0a6057', '9d37af6e-78de-449d-b5e0-a5d3c315f2ac', 'ca539e33-2c82-4062-a993-0201f6182493'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:25:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:25:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:25:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:25:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:25:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:25:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:25:43 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:25:43 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:25:43 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Aug 13 09:25:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.363s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:25:43 devstack cinder-volume[94670]: DEBUG cinder.manager [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:25:43 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Deleted volume successfully. Aug 13 09:25:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-cf02ca84-6dd5-4276-8147-2eedeb340939 req-6824196a-faa5-4ff4-a03d-bbbd6c9a134e tempest-VolumesGetTestJSON-589355167 None] Lock "cinder-9e30c745-d9f9-43d1-b321-737b4c2b2e33-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:25:53 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=11,cinder:SELECT=6,cinder:DELETE=1,cinder:INSERT=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:25:53 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=8,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:25:59 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-93d20fbe-0185-4e3a-8da0-4a42b7d6968d tempest-GroupsV320Test-1567938324 None] Group tempest-GroupsV320Test-Group-808081962: creating Aug 13 09:25:59 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-93d20fbe-0185-4e3a-8da0-4a42b7d6968d tempest-GroupsV320Test-1567938324 None] Group tempest-GroupsV320Test-Group-808081962: created successfully Aug 13 09:25:59 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-93d20fbe-0185-4e3a-8da0-4a42b7d6968d tempest-GroupsV320Test-1567938324 None] Create group completed successfully. Aug 13 09:26:00 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-5c1cf10e-63e7-4f3d-9316-ff57dd2b6892 tempest-GroupsV320Test-1567938324 None] Created reservations ['003d864c-feca-484a-8fca-9246893e0cf4'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5c1cf10e-63e7-4f3d-9316-ff57dd2b6892 tempest-GroupsV320Test-1567938324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5c1cf10e-63e7-4f3d-9316-ff57dd2b6892 tempest-GroupsV320Test-1567938324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5c1cf10e-63e7-4f3d-9316-ff57dd2b6892 tempest-GroupsV320Test-1567938324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5c1cf10e-63e7-4f3d-9316-ff57dd2b6892 tempest-GroupsV320Test-1567938324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5c1cf10e-63e7-4f3d-9316-ff57dd2b6892 tempest-GroupsV320Test-1567938324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5c1cf10e-63e7-4f3d-9316-ff57dd2b6892 tempest-GroupsV320Test-1567938324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Acquiring lock "cinder-4d53a529-fab6-4e64-8cde-8aa47163c4e5-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:01 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:26:01 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Lock "cinder-4d53a529-fab6-4e64-8cde-8aa47163c4e5-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Acquiring lock "cinder-quobyte-4d53a529-fab6-4e64-8cde-8aa47163c4e5" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Lock "cinder-quobyte-4d53a529-fab6-4e64-8cde-8aa47163c4e5" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe2a935-1591-4153-a3c6-6c79898bb82f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:01 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5c1cf10e-63e7-4f3d-9316-ff57dd2b6892 tempest-GroupsV320Test-1567938324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.359s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-5c1cf10e-63e7-4f3d-9316-ff57dd2b6892 tempest-GroupsV320Test-1567938324 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:26:01 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5c1cf10e-63e7-4f3d-9316-ff57dd2b6892 tempest-GroupsV320Test-1567938324 None] Delete group completed successfully. Aug 13 09:26:01 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5 Aug 13 09:26:01 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:01 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5" returned: 0 in 0.439s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:01 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5 Aug 13 09:26:01 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:02 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4d53a529-fab6-4e64-8cde-8aa47163c4e5" returned: 0 in 0.309s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Lock "cinder-quobyte-4d53a529-fab6-4e64-8cde-8aa47163c4e5" released by "delete_volume" :: held 0.822s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:02 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Created reservations ['2bb8d674-0639-4469-92c6-ebe92f46c99d', 'ed45a34b-8fb6-4010-a4a3-c67616c9d08e', '9d68259e-937a-4d04-a94d-387718fde021', '78f96af3-1d1b-4c41-9d46-1d7db11bb78f'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:26:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:02 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:26:02 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:02 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.432s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:02 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:26:02 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Deleted volume successfully. Aug 13 09:26:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e066509f-1be6-4527-8c02-98ca47d72bbd tempest-AttachVolumeShelveTestJSON-331936031 None] Lock "cinder-4d53a529-fab6-4e64-8cde-8aa47163c4e5-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:12 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=12,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:26:12 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=11,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Flow 'volume_create_manager' (333fdbb3-0b3c-4ad2-8efd-754593633a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafbd80f-9ee0-4e36-aea6-d2756bcfadf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafbd80f-9ee0-4e36-aea6-d2756bcfadf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1479679225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247e8499-077d-4d5b-80ac-f9dc16b3630f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609e6cdd90c646629787b2d9af1255a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:15Z,use_quota=True,user_id='705ee37b81d14d74a68356876336b8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6875c2-7079-4534-a32e-0b6322054c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6875c2-7079-4534-a32e-0b6322054c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b428def-70ee-4a5b-8f22-2e34ea7d20f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b428def-70ee-4a5b-8f22-2e34ea7d20f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '247e8499-077d-4d5b-80ac-f9dc16b3630f', 'volume_name': 'volume-247e8499-077d-4d5b-80ac-f9dc16b3630f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b06a654-cbcf-4972-813f-b1f5af9d1ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b06a654-cbcf-4972-813f-b1f5af9d1ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204086b0-2661-4421-8b62-ee7e33fc3904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:15 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Volume 247e8499-077d-4d5b-80ac-f9dc16b3630f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-247e8499-077d-4d5b-80ac-f9dc16b3630f', 'volume_size': 1} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1479679225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247e8499-077d-4d5b-80ac-f9dc16b3630f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609e6cdd90c646629787b2d9af1255a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:15Z,use_quota=True,user_id='705ee37b81d14d74a68356876336b8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Creating volume 247e8499-077d-4d5b-80ac-f9dc16b3630f {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:26:15 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-247e8499-077d-4d5b-80ac-f9dc16b3630f 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:15 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-247e8499-077d-4d5b-80ac-f9dc16b3630f 1073741824 Aug 13 09:26:15 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Flow 'volume_create_manager' (16d14946-deeb-4441-8efe-158007826aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8685c8c5-e6bf-455c-91fe-9adf082f9093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8685c8c5-e6bf-455c-91fe-9adf082f9093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1604644456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9543910-8610-4bbc-a289-10432e485dac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21a4923fa3b04a4db3ae1426dfd137d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:16Z,use_quota=True,user_id='c4a4435b679c496eabcf282b5cbc3264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbce2503-65d7-4526-82d4-70c72fe3faa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbce2503-65d7-4526-82d4-70c72fe3faa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a31f00-f950-4fd6-9c9e-a8895aa04b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a31f00-f950-4fd6-9c9e-a8895aa04b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9543910-8610-4bbc-a289-10432e485dac', 'volume_name': 'volume-e9543910-8610-4bbc-a289-10432e485dac', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32453b9-47ef-402b-b2b8-d1da069bc4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32453b9-47ef-402b-b2b8-d1da069bc4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af095a9c-81f7-4ebb-a244-73aa7c110a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:16 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Volume e9543910-8610-4bbc-a289-10432e485dac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9543910-8610-4bbc-a289-10432e485dac', 'volume_size': 1} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:16 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-247e8499-077d-4d5b-80ac-f9dc16b3630f 1073741824" returned: 0 in 0.644s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-247e8499-077d-4d5b-80ac-f9dc16b3630f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:16 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-247e8499-077d-4d5b-80ac-f9dc16b3630f Aug 13 09:26:16 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:16 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-247e8499-077d-4d5b-80ac-f9dc16b3630f" returned: 0 in 0.287s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.443s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1604644456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9543910-8610-4bbc-a289-10432e485dac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21a4923fa3b04a4db3ae1426dfd137d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:16Z,use_quota=True,user_id='c4a4435b679c496eabcf282b5cbc3264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Creating volume e9543910-8610-4bbc-a289-10432e485dac {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:26:16 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9543910-8610-4bbc-a289-10432e485dac 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204086b0-2661-4421-8b62-ee7e33fc3904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-247e8499-077d-4d5b-80ac-f9dc16b3630f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba42518-68f3-43f5-aa7d-f8525fb603c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:16 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9543910-8610-4bbc-a289-10432e485dac 1073741824 Aug 13 09:26:16 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:16 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Volume volume-247e8499-077d-4d5b-80ac-f9dc16b3630f (247e8499-077d-4d5b-80ac-f9dc16b3630f): created successfully Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba42518-68f3-43f5-aa7d-f8525fb603c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Flow 'volume_create_manager' (333fdbb3-0b3c-4ad2-8efd-754593633a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:16 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-30955f04-264e-4d63-b56b-1e672de47a61 tempest-AttachVolumeTestJSON-488212827 None] Created volume successfully. Aug 13 09:26:17 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9543910-8610-4bbc-a289-10432e485dac 1073741824" returned: 0 in 0.613s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9543910-8610-4bbc-a289-10432e485dac {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:17 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9543910-8610-4bbc-a289-10432e485dac Aug 13 09:26:17 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:17 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9543910-8610-4bbc-a289-10432e485dac" returned: 0 in 0.304s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:26:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af095a9c-81f7-4ebb-a244-73aa7c110a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9543910-8610-4bbc-a289-10432e485dac', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ef1088-6b93-40f7-89ee-bd37b6dce46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:17 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Volume volume-e9543910-8610-4bbc-a289-10432e485dac (e9543910-8610-4bbc-a289-10432e485dac): created successfully Aug 13 09:26:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ef1088-6b93-40f7-89ee-bd37b6dce46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Flow 'volume_create_manager' (16d14946-deeb-4441-8efe-158007826aa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:17 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-35b72c72-7bc5-4e38-8e49-37a964b94069 tempest-VolumesTestJSON-304004082 None] Created volume successfully. Aug 13 09:26:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-a9035ecc-9177-4ec6-9672-bb88af67661b req-b86d8147-6266-4338-a037-942d6f500b68 tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-a9035ecc-9177-4ec6-9672-bb88af67661b req-b86d8147-6266-4338-a037-942d6f500b68 tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:18 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c692c10b-f460-4a56-9fb9-122faa74f30a]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-a9035ecc-9177-4ec6-9672-bb88af67661b req-b86d8147-6266-4338-a037-942d6f500b68 tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-247e8499-077d-4d5b-80ac-f9dc16b3630f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:18 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-247e8499-077d-4d5b-80ac-f9dc16b3630f Aug 13 09:26:18 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:19 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-a9035ecc-9177-4ec6-9672-bb88af67661b req-b86d8147-6266-4338-a037-942d6f500b68 tempest-AttachVolumeTestJSON-488212827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-247e8499-077d-4d5b-80ac-f9dc16b3630f" returned: 0 in 0.614s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-a9035ecc-9177-4ec6-9672-bb88af67661b req-b86d8147-6266-4338-a037-942d6f500b68 tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.651s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Flow 'volume_create_manager' (d6084395-e72d-4209-bd99-0754713bdfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba81e7c-f57b-442f-920e-1ac4f13e71e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-a9035ecc-9177-4ec6-9672-bb88af67661b req-b86d8147-6266-4338-a037-942d6f500b68 tempest-AttachVolumeTestJSON-488212827 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-247e8499-077d-4d5b-80ac-f9dc16b3630f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd73378c5-3ed9-4b96-80b5-204171e05d24', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba81e7c-f57b-442f-920e-1ac4f13e71e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-361153353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb647a3-9eb9-4e00-8e15-135cb4d711fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21a4923fa3b04a4db3ae1426dfd137d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:19Z,use_quota=True,user_id='c4a4435b679c496eabcf282b5cbc3264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99d4d15-cb96-4d3e-821b-e7b7727c00fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99d4d15-cb96-4d3e-821b-e7b7727c00fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536489f6-7787-4ce6-8acc-224e1b8bf053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536489f6-7787-4ce6-8acc-224e1b8bf053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb647a3-9eb9-4e00-8e15-135cb4d711fd', 'volume_name': 'volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f989c19f-0bd7-4bda-9c80-71993ec4715b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f989c19f-0bd7-4bda-9c80-71993ec4715b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce858f4-df97-41a7-80e1-a081dd8ec6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:19 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Volume aeb647a3-9eb9-4e00-8e15-135cb4d711fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd', 'volume_size': 1} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-361153353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb647a3-9eb9-4e00-8e15-135cb4d711fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21a4923fa3b04a4db3ae1426dfd137d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:19Z,use_quota=True,user_id='c4a4435b679c496eabcf282b5cbc3264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Creating volume aeb647a3-9eb9-4e00-8e15-135cb4d711fd {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:26:19 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:26:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:19 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd 1073741824 Aug 13 09:26:19 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:19 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-a9035ecc-9177-4ec6-9672-bb88af67661b req-b86d8147-6266-4338-a037-942d6f500b68 tempest-AttachVolumeTestJSON-488212827 None] attachment_update completed successfully. Aug 13 09:26:20 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd 1073741824" returned: 0 in 0.592s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:20 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd Aug 13 09:26:20 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:20 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd" returned: 0 in 0.351s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:26:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce858f4-df97-41a7-80e1-a081dd8ec6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a6e6e4-1305-4321-bf47-35293b8a992c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:20 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Volume volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd (aeb647a3-9eb9-4e00-8e15-135cb4d711fd): created successfully Aug 13 09:26:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a6e6e4-1305-4321-bf47-35293b8a992c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Flow 'volume_create_manager' (d6084395-e72d-4209-bd99-0754713bdfaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:20 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-aa405b6c-0b84-4f93-bfd2-f0e503ff0e7c tempest-VolumesTestJSON-304004082 None] Created volume successfully. Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Flow 'volume_create_manager' (e9f65c0d-5fb4-410c-9c0c-920f55ac0f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64cf196-87cc-42fc-bee5-63bf14a52f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64cf196-87cc-42fc-bee5-63bf14a52f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1032273974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026810a0-e627-4f3c-ae66-d3a8d677765f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21a4923fa3b04a4db3ae1426dfd137d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:22Z,use_quota=True,user_id='c4a4435b679c496eabcf282b5cbc3264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c4d71d-2342-405d-b132-d8fc77db32c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c4d71d-2342-405d-b132-d8fc77db32c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd03b64e-5ad8-4e56-9400-edd43639c837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd03b64e-5ad8-4e56-9400-edd43639c837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '026810a0-e627-4f3c-ae66-d3a8d677765f', 'volume_name': 'volume-026810a0-e627-4f3c-ae66-d3a8d677765f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9c754a-ad76-4032-92ca-b5c0a37a10ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9c754a-ad76-4032-92ca-b5c0a37a10ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e6e311-51c2-4062-b0a1-34fb5f225443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:22 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Volume 026810a0-e627-4f3c-ae66-d3a8d677765f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-026810a0-e627-4f3c-ae66-d3a8d677765f', 'volume_size': 1} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1032273974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026810a0-e627-4f3c-ae66-d3a8d677765f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21a4923fa3b04a4db3ae1426dfd137d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:22Z,use_quota=True,user_id='c4a4435b679c496eabcf282b5cbc3264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Creating volume 026810a0-e627-4f3c-ae66-d3a8d677765f {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:26:22 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-026810a0-e627-4f3c-ae66-d3a8d677765f 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:22 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-026810a0-e627-4f3c-ae66-d3a8d677765f 1073741824 Aug 13 09:26:22 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Flow 'volume_create_manager' (14492ce2-c988-4888-84fd-7a1096ce7e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a347ca1-2efb-48b4-abc7-628f1733fa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:22 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-026810a0-e627-4f3c-ae66-d3a8d677765f 1073741824" returned: 0 in 0.558s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a347ca1-2efb-48b4-abc7-628f1733fa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1114628093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a55c55-5671-4d2c-b3b1-fe88aae68bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25400c7835c84d8bbd7e0f3130a84dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:23Z,use_quota=True,user_id='7cc42c6b94de4c6ea7dc3c4b9ad28cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8df11c7-5550-49f7-9fcf-8647ee91d6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8df11c7-5550-49f7-9fcf-8647ee91d6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d54d75c-1392-4b09-ae09-5cfc5fac095e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d54d75c-1392-4b09-ae09-5cfc5fac095e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a55c55-5671-4d2c-b3b1-fe88aae68bf8', 'volume_name': 'volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf752529-c383-44b6-9ea1-cc8de35300f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf752529-c383-44b6-9ea1-cc8de35300f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac9490e-6c23-46be-a982-2e1239db654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:22 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Volume 94a55c55-5671-4d2c-b3b1-fe88aae68bf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8', 'volume_size': 1} Aug 13 09:26:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-026810a0-e627-4f3c-ae66-d3a8d677765f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:23 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-026810a0-e627-4f3c-ae66-d3a8d677765f Aug 13 09:26:23 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:23 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-026810a0-e627-4f3c-ae66-d3a8d677765f" returned: 0 in 0.357s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.397s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1114628093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a55c55-5671-4d2c-b3b1-fe88aae68bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25400c7835c84d8bbd7e0f3130a84dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:23Z,use_quota=True,user_id='7cc42c6b94de4c6ea7dc3c4b9ad28cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Creating volume 94a55c55-5671-4d2c-b3b1-fe88aae68bf8 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:26:23 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e6e311-51c2-4062-b0a1-34fb5f225443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-026810a0-e627-4f3c-ae66-d3a8d677765f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:23 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8 1073741824 Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e17bb22-221f-4a7c-b7f5-88c3240c97fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:23 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:23 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Volume volume-026810a0-e627-4f3c-ae66-d3a8d677765f (026810a0-e627-4f3c-ae66-d3a8d677765f): created successfully Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e17bb22-221f-4a7c-b7f5-88c3240c97fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Flow 'volume_create_manager' (e9f65c0d-5fb4-410c-9c0c-920f55ac0f97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:23 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6fc0f7bb-1d45-42a8-9d39-756a158b69ea tempest-VolumesTestJSON-304004082 None] Created volume successfully. Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Flow 'volume_create_manager' (525250fb-4d92-410d-a1f1-6fe15b78c2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07127ba1-5204-4b22-9b1c-45206ca46e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07127ba1-5204-4b22-9b1c-45206ca46e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-284848085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d764896-5ae9-48a1-b78b-70c1dc3c6827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647f9b25a17a486191f466712064b244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:24Z,use_quota=True,user_id='01525130d222424ab65f55ee3f832dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186a2ad8-f75f-42a7-b0ab-0b5a03c633b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186a2ad8-f75f-42a7-b0ab-0b5a03c633b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18094017-a7a0-41a4-951e-4b2568f42626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18094017-a7a0-41a4-951e-4b2568f42626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d764896-5ae9-48a1-b78b-70c1dc3c6827', 'volume_name': 'volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1419f5b-359d-4f99-9830-32acbe3cc41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1419f5b-359d-4f99-9830-32acbe3cc41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cf0142-0eaf-4475-a816-fa1c397ac399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:23 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Volume 9d764896-5ae9-48a1-b78b-70c1dc3c6827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827', 'volume_size': 1} Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:23 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8 1073741824" returned: 0 in 0.572s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:24 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8 Aug 13 09:26:24 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:24 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8" returned: 0 in 0.276s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-284848085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d764896-5ae9-48a1-b78b-70c1dc3c6827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647f9b25a17a486191f466712064b244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:24Z,use_quota=True,user_id='01525130d222424ab65f55ee3f832dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Creating volume 9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:26:24 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac9490e-6c23-46be-a982-2e1239db654a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:24 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 1073741824 Aug 13 09:26:24 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f71e5dd-8c1b-4ec1-bd38-988f190540cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:24 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Volume volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8 (94a55c55-5671-4d2c-b3b1-fe88aae68bf8): created successfully Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f71e5dd-8c1b-4ec1-bd38-988f190540cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Flow 'volume_create_manager' (14492ce2-c988-4888-84fd-7a1096ce7e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:24 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d2afe65a-4308-4a38-b9d7-0cad4ef6c41c tempest-VolumesListAdminTestJSON-1638780707 None] Created volume successfully. Aug 13 09:26:25 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 1073741824" returned: 0 in 0.759s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:25 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 Aug 13 09:26:25 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:25 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827" returned: 0 in 0.552s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cf0142-0eaf-4475-a816-fa1c397ac399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace365cc-f561-4119-b89b-05db9546545c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:25 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Volume volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 (9d764896-5ae9-48a1-b78b-70c1dc3c6827): created successfully Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace365cc-f561-4119-b89b-05db9546545c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Flow 'volume_create_manager' (525250fb-4d92-410d-a1f1-6fe15b78c2d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:25 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-51c43413-1c59-45e4-85dc-9480b9860e4f tempest-SnapshotsActionsTest-193655122 None] Created volume successfully. Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Acquiring lock "cinder-026810a0-e627-4f3c-ae66-d3a8d677765f-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Lock "cinder-026810a0-e627-4f3c-ae66-d3a8d677765f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Acquiring lock "cinder-quobyte-026810a0-e627-4f3c-ae66-d3a8d677765f" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Lock "cinder-quobyte-026810a0-e627-4f3c-ae66-d3a8d677765f" acquired by "delete_volume" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff3f452-a031-4098-b1b0-5bdd9a61e1b2]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-026810a0-e627-4f3c-ae66-d3a8d677765f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:25 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Flow 'volume_create_manager' (cba39bcc-c0fb-4bd0-9ec7-820a9b63ffba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09ea236-2fd4-41f4-8759-9d55a07b4479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09ea236-2fd4-41f4-8759-9d55a07b4479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-431812858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c873a6-0db7-4c15-98bf-421635a17449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25400c7835c84d8bbd7e0f3130a84dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:26Z,use_quota=True,user_id='7cc42c6b94de4c6ea7dc3c4b9ad28cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39fa242-2e58-41b9-98d9-4a5696bf72cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:26 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-026810a0-e627-4f3c-ae66-d3a8d677765f Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39fa242-2e58-41b9-98d9-4a5696bf72cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:26 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c0d71a-19bc-4100-b407-af320353e6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c0d71a-19bc-4100-b407-af320353e6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8c873a6-0db7-4c15-98bf-421635a17449', 'volume_name': 'volume-a8c873a6-0db7-4c15-98bf-421635a17449', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd65b9e-0ea9-45a4-8562-75c37b97e97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd65b9e-0ea9-45a4-8562-75c37b97e97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772aeddd-ace0-40e6-9997-d11ad5b70cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:26 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Volume a8c873a6-0db7-4c15-98bf-421635a17449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8c873a6-0db7-4c15-98bf-421635a17449', 'volume_size': 1} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-431812858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c873a6-0db7-4c15-98bf-421635a17449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25400c7835c84d8bbd7e0f3130a84dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:26Z,use_quota=True,user_id='7cc42c6b94de4c6ea7dc3c4b9ad28cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Creating volume a8c873a6-0db7-4c15-98bf-421635a17449 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:26:26 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a8c873a6-0db7-4c15-98bf-421635a17449 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:26 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a8c873a6-0db7-4c15-98bf-421635a17449 1073741824 Aug 13 09:26:26 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:26 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-026810a0-e627-4f3c-ae66-d3a8d677765f" returned: 0 in 0.499s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-026810a0-e627-4f3c-ae66-d3a8d677765f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:26 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-026810a0-e627-4f3c-ae66-d3a8d677765f Aug 13 09:26:26 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:26 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-026810a0-e627-4f3c-ae66-d3a8d677765f" returned: 0 in 0.449s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:26 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a8c873a6-0db7-4c15-98bf-421635a17449 1073741824" returned: 0 in 0.790s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Lock "cinder-quobyte-026810a0-e627-4f3c-ae66-d3a8d677765f" released by "delete_volume" :: held 1.002s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a8c873a6-0db7-4c15-98bf-421635a17449 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Created reservations ['84874950-50b0-4a6a-b26d-e551453ca2f0', '4ab32363-10c7-4787-bf59-8988c0af2639', '37b337d1-1a42-4c09-8dd9-90bc7f2d1b40', 'ea3dc030-09be-4d04-8170-45a3054aebd1'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:26:27 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a8c873a6-0db7-4c15-98bf-421635a17449 Aug 13 09:26:27 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:27 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:26:27 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:27 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a8c873a6-0db7-4c15-98bf-421635a17449" returned: 0 in 0.558s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.174s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] Creating offline snapshot 631e02ae-728a-43a1-838f-350d972501f8 of volume 9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772aeddd-ace0-40e6-9997-d11ad5b70cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c873a6-0db7-4c15-98bf-421635a17449', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573b19c5-6ed3-4785-8274-5940a74bfd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d770bb4d-2674-4dd2-9883-2163a4ca0192]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:27 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Volume volume-a8c873a6-0db7-4c15-98bf-421635a17449 (a8c873a6-0db7-4c15-98bf-421635a17449): created successfully Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573b19c5-6ed3-4785-8274-5940a74bfd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Flow 'volume_create_manager' (cba39bcc-c0fb-4bd0-9ec7-820a9b63ffba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:27 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-55dd15a9-62f1-43f6-9ea6-51882a82554d tempest-VolumesListAdminTestJSON-1638780707 None] Created volume successfully. Aug 13 09:26:27 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.403s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:26:27 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Deleted volume successfully. Aug 13 09:26:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-994f1a96-d9e4-457e-b42e-486599085249 tempest-VolumesTestJSON-304004082 None] Lock "cinder-026810a0-e627-4f3c-ae66-d3a8d677765f-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:27 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 Aug 13 09:26:27 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:28 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827" returned: 0 in 0.411s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:28 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 1G Aug 13 09:26:28 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Acquiring lock "cinder-aeb647a3-9eb9-4e00-8e15-135cb4d711fd-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Lock "cinder-aeb647a3-9eb9-4e00-8e15-135cb4d711fd-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Acquiring lock "cinder-quobyte-aeb647a3-9eb9-4e00-8e15-135cb4d711fd" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Lock "cinder-quobyte-aeb647a3-9eb9-4e00-8e15-135cb4d711fd" acquired by "delete_volume" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee34c683-4165-42c0-af0d-293564bbef12]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:26:28 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd Aug 13 09:26:28 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:28 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Flow 'volume_create_manager' (b5fbff05-1049-46a3-b64b-0fa3ab72b140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b07dcf-f0ea-484e-b448-773e9813bd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 1G" returned: 0 in 0.751s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:28 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 Aug 13 09:26:28 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b07dcf-f0ea-484e-b448-773e9813bd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1959644848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3198bf61-5e36-461f-bc03-a1326fad3658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25400c7835c84d8bbd7e0f3130a84dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:29Z,use_quota=True,user_id='7cc42c6b94de4c6ea7dc3c4b9ad28cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070d699c-7fb5-443c-a37f-3e1caaf0af45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070d699c-7fb5-443c-a37f-3e1caaf0af45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faabea2f-ea71-4152-972c-678ee5f191cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faabea2f-ea71-4152-972c-678ee5f191cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3198bf61-5e36-461f-bc03-a1326fad3658', 'volume_name': 'volume-3198bf61-5e36-461f-bc03-a1326fad3658', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e72aa90-82fa-4b91-a2b3-e7f116686b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e72aa90-82fa-4b91-a2b3-e7f116686b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59fde74c-0161-4de1-b1c5-7a7b60585691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:28 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Volume 3198bf61-5e36-461f-bc03-a1326fad3658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3198bf61-5e36-461f-bc03-a1326fad3658', 'volume_size': 1} Aug 13 09:26:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:29 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd" returned: 0 in 0.596s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:29 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd Aug 13 09:26:29 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:29 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8" returned: 0 in 0.323s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:29 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 is being set with open permissions: ugo+rw Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:29 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 Aug 13 09:26:29 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:29 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aeb647a3-9eb9-4e00-8e15-135cb4d711fd" returned: 0 in 0.314s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Lock "cinder-quobyte-aeb647a3-9eb9-4e00-8e15-135cb4d711fd" released by "delete_volume" :: held 0.995s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:29 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8" returned: 0 in 0.426s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Created reservations ['d67ab4c8-354c-42f8-8c3e-c8fa260b9861', '88e5592a-2e45-4e86-9efe-3045b3f67339', 'ef6b3050-2c8b-4097-a29a-6c368f065c80', 'c04b8781-8558-4574-bfb8-8d1f5c75811c'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:29 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.info Aug 13 09:26:29 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:29 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:26:29 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:29 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.info" returned: 0 in 0.296s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:29 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.info is being set with open permissions: ugo+rw Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:29 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.info Aug 13 09:26:29 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:29 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.292s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:29 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:26:29 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Deleted volume successfully. Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-14dcdd4b-a59e-49b6-a64a-89d7923753f5 tempest-VolumesTestJSON-304004082 None] Lock "cinder-aeb647a3-9eb9-4e00-8e15-135cb4d711fd-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:30 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.info" returned: 0 in 0.298s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.653s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.329s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1959644848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3198bf61-5e36-461f-bc03-a1326fad3658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25400c7835c84d8bbd7e0f3130a84dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:29Z,use_quota=True,user_id='7cc42c6b94de4c6ea7dc3c4b9ad28cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Creating volume 3198bf61-5e36-461f-bc03-a1326fad3658 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:26:30 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3198bf61-5e36-461f-bc03-a1326fad3658 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:30 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3198bf61-5e36-461f-bc03-a1326fad3658 1073741824 Aug 13 09:26:30 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:30 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-12f584b9-bc0f-42eb-8863-6bf2af4907e2 tempest-SnapshotsActionsTest-193655122 None] Create snapshot completed successfully Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Acquiring lock "cinder-e9543910-8610-4bbc-a289-10432e485dac-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Lock "cinder-e9543910-8610-4bbc-a289-10432e485dac-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Acquiring lock "cinder-quobyte-e9543910-8610-4bbc-a289-10432e485dac" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Lock "cinder-quobyte-e9543910-8610-4bbc-a289-10432e485dac" acquired by "delete_volume" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8f3a68-3692-4657-9ff5-ffd0a8cf594a]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9543910-8610-4bbc-a289-10432e485dac {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:30 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3198bf61-5e36-461f-bc03-a1326fad3658 1073741824" returned: 0 in 0.685s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3198bf61-5e36-461f-bc03-a1326fad3658 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:30 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9543910-8610-4bbc-a289-10432e485dac Aug 13 09:26:30 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:31 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3198bf61-5e36-461f-bc03-a1326fad3658 Aug 13 09:26:31 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3dc4be1f-27ae-4dda-a288-074640c5602f tempest-SnapshotsActionsTest-193655122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:31 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3198bf61-5e36-461f-bc03-a1326fad3658" returned: 0 in 0.376s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3dc4be1f-27ae-4dda-a288-074640c5602f tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.122s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:31 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59fde74c-0161-4de1-b1c5-7a7b60585691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3198bf61-5e36-461f-bc03-a1326fad3658', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849ea5d0-36e6-4ffd-a654-2e88008a7168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9543910-8610-4bbc-a289-10432e485dac" returned: 0 in 0.540s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9543910-8610-4bbc-a289-10432e485dac {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-3dc4be1f-27ae-4dda-a288-074640c5602f tempest-SnapshotsActionsTest-193655122 None] Creating offline snapshot 3543946d-8acd-4dac-885a-170bc8c2beb3 of volume 9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:26:31 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9543910-8610-4bbc-a289-10432e485dac Aug 13 09:26:31 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:31 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Volume volume-3198bf61-5e36-461f-bc03-a1326fad3658 (3198bf61-5e36-461f-bc03-a1326fad3658): created successfully Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849ea5d0-36e6-4ffd-a654-2e88008a7168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Flow 'volume_create_manager' (b5fbff05-1049-46a3-b64b-0fa3ab72b140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ec2ca9-fda2-48d0-9fd8-7b0954ce1de5]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3dc4be1f-27ae-4dda-a288-074640c5602f tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:31 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6e4f00d5-d366-4d66-b850-b8659d18e615 tempest-VolumesListAdminTestJSON-1638780707 None] Created volume successfully. Aug 13 09:26:31 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 Aug 13 09:26:31 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:31 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9543910-8610-4bbc-a289-10432e485dac" returned: 0 in 0.274s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Lock "cinder-quobyte-e9543910-8610-4bbc-a289-10432e485dac" released by "delete_volume" :: held 0.871s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Created reservations ['dc28480a-c8c2-473a-b123-cdfcf89d6cf5', '91432364-21a3-4126-82dd-dca1c1eac1c8', 'd9d672fb-bbe5-479e-ba53-8bd7e1c3bdcd', 'd61d1650-959d-4aaf-9a49-b064a5b19d80'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:31 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:26:31 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:31 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3dc4be1f-27ae-4dda-a288-074640c5602f tempest-SnapshotsActionsTest-193655122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8" returned: 0 in 0.510s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-3dc4be1f-27ae-4dda-a288-074640c5602f tempest-SnapshotsActionsTest-193655122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:26:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3dc4be1f-27ae-4dda-a288-074640c5602f tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:32 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3 1G Aug 13 09:26:32 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:32 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.425s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:32 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:26:32 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Deleted volume successfully. Aug 13 09:26:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-44c67286-64a2-44ee-867d-2c0a0de39340 tempest-VolumesTestJSON-304004082 None] Lock "cinder-e9543910-8610-4bbc-a289-10432e485dac-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:32 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3dc4be1f-27ae-4dda-a288-074640c5602f tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3 1G" returned: 0 in 0.768s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3dc4be1f-27ae-4dda-a288-074640c5602f tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:32 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3 Aug 13 09:26:32 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Flow 'volume_create_manager' (4474fd68-e655-4607-8a65-b9811d365220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa51109-5151-4d45-afb7-9d8bdcb15713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa51109-5151-4d45-afb7-9d8bdcb15713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75304c06-b1c1-4987-9117-b2e1adccb550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfc58a470544e5e85b8a33f5c9212a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:33Z,use_quota=True,user_id='ffcf87a1431140769726f634655f9e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4344a9bc-868e-4582-8c8a-c00f41bd2383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4344a9bc-868e-4582-8c8a-c00f41bd2383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513c0cdf-e7df-4496-a915-c1a022574eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513c0cdf-e7df-4496-a915-c1a022574eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75304c06-b1c1-4987-9117-b2e1adccb550', 'volume_name': 'volume-75304c06-b1c1-4987-9117-b2e1adccb550', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea1015b-e861-44ba-b368-4a7fa6e491bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea1015b-e861-44ba-b368-4a7fa6e491bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7810af-ecfc-4038-a390-13c5170ef5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:33 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Volume 75304c06-b1c1-4987-9117-b2e1adccb550: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75304c06-b1c1-4987-9117-b2e1adccb550', 'volume_size': 1} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:33 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3dc4be1f-27ae-4dda-a288-074640c5602f tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3" returned: 0 in 0.476s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:33 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-3dc4be1f-27ae-4dda-a288-074640c5602f tempest-SnapshotsActionsTest-193655122 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3 is being set with open permissions: ugo+rw Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3dc4be1f-27ae-4dda-a288-074640c5602f tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:33 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3 Aug 13 09:26:33 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:33 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3dc4be1f-27ae-4dda-a288-074640c5602f tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3" returned: 0 in 0.293s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3dc4be1f-27ae-4dda-a288-074640c5602f tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.203s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.350s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75304c06-b1c1-4987-9117-b2e1adccb550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfc58a470544e5e85b8a33f5c9212a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:33Z,use_quota=True,user_id='ffcf87a1431140769726f634655f9e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Creating volume 75304c06-b1c1-4987-9117-b2e1adccb550 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:26:33 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:26:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-75304c06-b1c1-4987-9117-b2e1adccb550 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:33 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-75304c06-b1c1-4987-9117-b2e1adccb550 1073741824 Aug 13 09:26:33 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3dc4be1f-27ae-4dda-a288-074640c5602f tempest-SnapshotsActionsTest-193655122 None] Create snapshot completed successfully Aug 13 09:26:33 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:34 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-75304c06-b1c1-4987-9117-b2e1adccb550 1073741824" returned: 0 in 0.549s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-75304c06-b1c1-4987-9117-b2e1adccb550 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:34 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-75304c06-b1c1-4987-9117-b2e1adccb550 Aug 13 09:26:34 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:34 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-75304c06-b1c1-4987-9117-b2e1adccb550" returned: 0 in 0.266s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Acquiring lock "cinder-3543946d-8acd-4dac-885a-170bc8c2beb3-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7810af-ecfc-4038-a390-13c5170ef5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75304c06-b1c1-4987-9117-b2e1adccb550', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32429a8-35d1-476d-90e7-a9fac4282c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-3543946d-8acd-4dac-885a-170bc8c2beb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Acquiring lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Acquiring lock "cinder-quobyte-3543946d-8acd-4dac-885a-170bc8c2beb3" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-3543946d-8acd-4dac-885a-170bc8c2beb3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Deleting offline snapshot 3543946d-8acd-4dac-885a-170bc8c2beb3 of volume 9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] snapshot_file for this snap is: volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dfd347-fdb3-465e-b48b-b0ef862aa6e9]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:35 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3 Aug 13 09:26:35 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:35 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Volume volume-75304c06-b1c1-4987-9117-b2e1adccb550 (75304c06-b1c1-4987-9117-b2e1adccb550): created successfully Aug 13 09:26:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32429a8-35d1-476d-90e7-a9fac4282c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Flow 'volume_create_manager' (4474fd68-e655-4607-8a65-b9811d365220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:35 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-dc210edb-6058-428a-8c24-1371d353086b tempest-VolumesListAdminTestJSON-1204896990 None] Created volume successfully. Aug 13 09:26:35 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3" returned: 0 in 0.394s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:26:35 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2ffc3e-885a-4904-9fe0-e04def3f3b53]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:35 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 Aug 13 09:26:35 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:35 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8" returned: 0 in 0.410s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:26:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:35 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3 Aug 13 09:26:35 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:36 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3" returned: 0 in 0.444s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:36 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3 Aug 13 09:26:36 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:36 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.3543946d-8acd-4dac-885a-170bc8c2beb3" returned: 0 in 0.324s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Acquiring lock "cinder-75304c06-b1c1-4987-9117-b2e1adccb550-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-3543946d-8acd-4dac-885a-170bc8c2beb3" released by "_delete_snapshot" :: held 1.698s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" released by "delete_snapshot" :: held 1.741s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Lock "cinder-75304c06-b1c1-4987-9117-b2e1adccb550-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Acquiring lock "cinder-quobyte-75304c06-b1c1-4987-9117-b2e1adccb550" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Lock "cinder-quobyte-75304c06-b1c1-4987-9117-b2e1adccb550" acquired by "delete_volume" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:36 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb01138e-24e9-485e-a81c-d4980c8ff76e]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-75304c06-b1c1-4987-9117-b2e1adccb550 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:36 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-75304c06-b1c1-4987-9117-b2e1adccb550 Aug 13 09:26:36 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:37 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Created reservations ['95eac9c9-f3f7-4c7b-8aaf-1aabcbe26bc4', 'a1d41299-43e2-458b-967f-a74301c92d65', 'd293c2c8-051f-4005-bfbd-e1d0f2fbc3ad', '2e64333a-b6f7-45a6-bd4f-4d634ca39198'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:26:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Acquiring lock "cinder-3198bf61-5e36-461f-bc03-a1326fad3658-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Lock "cinder-3198bf61-5e36-461f-bc03-a1326fad3658-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:37 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-75304c06-b1c1-4987-9117-b2e1adccb550" returned: 0 in 0.508s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-75304c06-b1c1-4987-9117-b2e1adccb550 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:37 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-75304c06-b1c1-4987-9117-b2e1adccb550 Aug 13 09:26:37 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:37 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Delete snapshot completed successfully. Aug 13 09:26:37 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Acquiring lock "cinder-quobyte-3198bf61-5e36-461f-bc03-a1326fad3658" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-75304c06-b1c1-4987-9117-b2e1adccb550" returned: 0 in 0.278s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1dbc9631-d77a-492b-bb6c-09c3f1bc505f tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-3543946d-8acd-4dac-885a-170bc8c2beb3-delete_snapshot" released by "delete_snapshot" :: held 2.748s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Lock "cinder-quobyte-75304c06-b1c1-4987-9117-b2e1adccb550" released by "delete_volume" :: held 0.831s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Lock "cinder-quobyte-3198bf61-5e36-461f-bc03-a1326fad3658" acquired by "delete_volume" :: waited 0.029s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:37 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5cbf61-8b74-44ee-80cd-29df2a8a8657]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3198bf61-5e36-461f-bc03-a1326fad3658 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:37 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3198bf61-5e36-461f-bc03-a1326fad3658 Aug 13 09:26:37 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:38 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3198bf61-5e36-461f-bc03-a1326fad3658" returned: 0 in 0.426s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3198bf61-5e36-461f-bc03-a1326fad3658 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:38 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3198bf61-5e36-461f-bc03-a1326fad3658 Aug 13 09:26:38 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:38 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Created reservations ['df3291bf-5982-473c-b2c5-fa1035635001', 'c9f1755a-d795-4473-83b2-0b42fe655083', 'f0224703-b50b-4a8b-a784-e0da002cbf63', '4e71b81b-e343-42ee-b16a-27da510e39d2'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:26:38 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3198bf61-5e36-461f-bc03-a1326fad3658" returned: 0 in 0.324s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Lock "cinder-quobyte-3198bf61-5e36-461f-bc03-a1326fad3658" released by "delete_volume" :: held 0.800s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:38 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:26:38 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:38 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Created reservations ['7dcfbcb4-52d9-4b58-95d1-58a3ac338320', 'fc2e26dd-72dd-4beb-9690-fc764811dece', 'abaff924-fd45-490f-a7cd-2cd338ba91fa', '2a62d402-d71d-45a8-a21c-d6dd3da90556'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:26:38 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.310s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:38 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:26:38 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Deleted volume successfully. Aug 13 09:26:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7f77b855-f274-4372-87dd-111d487ea988 tempest-VolumesListAdminTestJSON-1204896990 None] Lock "cinder-75304c06-b1c1-4987-9117-b2e1adccb550-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:39 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:26:39 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0b60ce18-6060-44b7-8ed8-424c3a94d9cd tempest-SnapshotsActionsTest-193655122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0b60ce18-6060-44b7-8ed8-424c3a94d9cd tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-0b60ce18-6060-44b7-8ed8-424c3a94d9cd tempest-SnapshotsActionsTest-193655122 None] Creating offline snapshot b391b6a3-028e-4d9e-ad2b-6a075cf5b697 of volume 9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26ade9e-2621-4e44-8935-c785221e1863]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0b60ce18-6060-44b7-8ed8-424c3a94d9cd tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Acquiring lock "cinder-a8c873a6-0db7-4c15-98bf-421635a17449-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:39 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.332s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Lock "cinder-a8c873a6-0db7-4c15-98bf-421635a17449-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:39 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Deleted volume successfully. Aug 13 09:26:39 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 Aug 13 09:26:39 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Acquiring lock "cinder-quobyte-a8c873a6-0db7-4c15-98bf-421635a17449" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-215a86e0-bf48-462b-93a2-4b548b494a5b tempest-VolumesListAdminTestJSON-1638780707 None] Lock "cinder-3198bf61-5e36-461f-bc03-a1326fad3658-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Lock "cinder-quobyte-a8c873a6-0db7-4c15-98bf-421635a17449" acquired by "delete_volume" :: waited 0.027s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6fe957-325b-40b9-b731-4de2b361ed4d]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a8c873a6-0db7-4c15-98bf-421635a17449 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:39 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a8c873a6-0db7-4c15-98bf-421635a17449 Aug 13 09:26:39 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:40 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0b60ce18-6060-44b7-8ed8-424c3a94d9cd tempest-SnapshotsActionsTest-193655122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8" returned: 0 in 0.550s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-0b60ce18-6060-44b7-8ed8-424c3a94d9cd tempest-SnapshotsActionsTest-193655122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0b60ce18-6060-44b7-8ed8-424c3a94d9cd tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:40 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697 1G Aug 13 09:26:40 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:40 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a8c873a6-0db7-4c15-98bf-421635a17449" returned: 0 in 0.462s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a8c873a6-0db7-4c15-98bf-421635a17449 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:40 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a8c873a6-0db7-4c15-98bf-421635a17449 Aug 13 09:26:40 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:40 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a8c873a6-0db7-4c15-98bf-421635a17449" returned: 0 in 0.312s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Lock "cinder-quobyte-a8c873a6-0db7-4c15-98bf-421635a17449" released by "delete_volume" :: held 0.831s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Created reservations ['775f61d6-7451-4c30-84e2-65fa39742c1e', '9232f64e-e1b5-44f4-acc3-a161ce482fef', '333db612-64d3-46aa-b63a-046653d3af48', '6e13fe2f-5cc3-4778-b97e-017c04a74c73'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:26:40 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0b60ce18-6060-44b7-8ed8-424c3a94d9cd tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697 1G" returned: 0 in 0.673s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0b60ce18-6060-44b7-8ed8-424c3a94d9cd tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:40 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697 Aug 13 09:26:40 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:40 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:26:40 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Acquiring lock "cinder-94a55c55-5671-4d2c-b3b1-fe88aae68bf8-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Lock "cinder-94a55c55-5671-4d2c-b3b1-fe88aae68bf8-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Acquiring lock "cinder-quobyte-94a55c55-5671-4d2c-b3b1-fe88aae68bf8" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Lock "cinder-quobyte-94a55c55-5671-4d2c-b3b1-fe88aae68bf8" acquired by "delete_volume" :: waited 0.041s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:41 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.426s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:41 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:26:41 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Deleted volume successfully. Aug 13 09:26:41 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c982113b-b370-42cc-ac40-df4c59a88091]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:41 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0b60ce18-6060-44b7-8ed8-424c3a94d9cd tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697" returned: 0 in 0.569s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:41 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-0b60ce18-6060-44b7-8ed8-424c3a94d9cd tempest-SnapshotsActionsTest-193655122 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697 is being set with open permissions: ugo+rw Aug 13 09:26:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0b60ce18-6060-44b7-8ed8-424c3a94d9cd tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7b7e430e-c9a2-4f93-8176-357faeea42bb tempest-VolumesListAdminTestJSON-1638780707 None] Lock "cinder-a8c873a6-0db7-4c15-98bf-421635a17449-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:41 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697 Aug 13 09:26:41 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:41 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8 Aug 13 09:26:41 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:41 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0b60ce18-6060-44b7-8ed8-424c3a94d9cd tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697" returned: 0 in 0.351s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0b60ce18-6060-44b7-8ed8-424c3a94d9cd tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.265s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:41 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-0b60ce18-6060-44b7-8ed8-424c3a94d9cd tempest-SnapshotsActionsTest-193655122 None] Create snapshot completed successfully Aug 13 09:26:41 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8" returned: 0 in 0.512s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:41 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8 Aug 13 09:26:41 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:42 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94a55c55-5671-4d2c-b3b1-fe88aae68bf8" returned: 0 in 0.305s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Lock "cinder-quobyte-94a55c55-5671-4d2c-b3b1-fe88aae68bf8" released by "delete_volume" :: held 0.870s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Created reservations ['5268a84a-d42c-4ce4-b08f-c2884f7b6f35', '7d263a6b-b289-4302-9217-a7c9e88d3725', '5762a117-70be-46e5-b34b-390d30d6c828', '60ea2b32-3298-4f00-a90a-6a961dc498e3'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:42 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:26:42 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Acquiring lock "cinder-b391b6a3-028e-4d9e-ad2b-6a075cf5b697-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-b391b6a3-028e-4d9e-ad2b-6a075cf5b697-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Acquiring lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Acquiring lock "cinder-quobyte-b391b6a3-028e-4d9e-ad2b-6a075cf5b697" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-b391b6a3-028e-4d9e-ad2b-6a075cf5b697" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Deleting offline snapshot b391b6a3-028e-4d9e-ad2b-6a075cf5b697 of volume 9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] snapshot_file for this snap is: volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a1bb5e-2093-4b96-bc64-827d10e54434]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:42 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.365s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:26:42 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Deleted volume successfully. Aug 13 09:26:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ead6fb23-e4c4-46a6-85ee-83f281129a55 tempest-VolumesListAdminTestJSON-1638780707 None] Lock "cinder-94a55c55-5671-4d2c-b3b1-fe88aae68bf8-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:42 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697 Aug 13 09:26:42 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:43 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:26:43 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:43 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697" returned: 0 in 0.575s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d23b07-2d30-436f-9e65-af60310c6bf3]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:43 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 Aug 13 09:26:43 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:43 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.409s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:26:43 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8" returned: 0 in 0.526s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:26:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:43 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697 Aug 13 09:26:43 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:44 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697" returned: 0 in 0.484s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:44 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697 Aug 13 09:26:44 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:44 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.b391b6a3-028e-4d9e-ad2b-6a075cf5b697" returned: 0 in 0.338s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-b391b6a3-028e-4d9e-ad2b-6a075cf5b697" released by "_delete_snapshot" :: held 2.068s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" released by "delete_snapshot" :: held 2.107s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:44 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Created reservations ['c3fa8efa-73e2-4a00-b56e-ca28658c75d2', '1d443acc-a4a8-4be1-9b90-b6278c8d4881', 'c4f860c7-c9aa-4751-bbba-cd0390b34a22', 'd6b4b7bd-a815-4ac5-9ea5-66bf19c37b63'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:26:44 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Delete snapshot completed successfully. Aug 13 09:26:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3bf5dd2f-ec46-4d72-a3a6-15d8a58b5523 tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-b391b6a3-028e-4d9e-ad2b-6a075cf5b697-delete_snapshot" released by "delete_snapshot" :: held 2.280s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1e8fb312-f23a-42ac-bbfe-2b9960c10e17 tempest-SnapshotsActionsTest-193655122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1e8fb312-f23a-42ac-bbfe-2b9960c10e17 tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:46 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1e8fb312-f23a-42ac-bbfe-2b9960c10e17 tempest-SnapshotsActionsTest-193655122 None] Creating offline snapshot 598c1e10-f3d6-4ca6-bf4e-12b11135a57c of volume 9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:26:46 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[be83b498-28b0-4213-a904-fdf828f57307]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1e8fb312-f23a-42ac-bbfe-2b9960c10e17 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:46 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 Aug 13 09:26:46 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:46 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1e8fb312-f23a-42ac-bbfe-2b9960c10e17 tempest-SnapshotsActionsTest-193655122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8" returned: 0 in 0.420s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:46 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1e8fb312-f23a-42ac-bbfe-2b9960c10e17 tempest-SnapshotsActionsTest-193655122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:26:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1e8fb312-f23a-42ac-bbfe-2b9960c10e17 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:46 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c 1G Aug 13 09:26:46 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:47 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1e8fb312-f23a-42ac-bbfe-2b9960c10e17 tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c 1G" returned: 0 in 0.581s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1e8fb312-f23a-42ac-bbfe-2b9960c10e17 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:47 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c Aug 13 09:26:47 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:47 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1e8fb312-f23a-42ac-bbfe-2b9960c10e17 tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c" returned: 0 in 0.340s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:47 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-1e8fb312-f23a-42ac-bbfe-2b9960c10e17 tempest-SnapshotsActionsTest-193655122 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c is being set with open permissions: ugo+rw Aug 13 09:26:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1e8fb312-f23a-42ac-bbfe-2b9960c10e17 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:47 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c Aug 13 09:26:47 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:47 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1e8fb312-f23a-42ac-bbfe-2b9960c10e17 tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c" returned: 0 in 0.307s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1e8fb312-f23a-42ac-bbfe-2b9960c10e17 tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.774s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:47 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-1e8fb312-f23a-42ac-bbfe-2b9960c10e17 tempest-SnapshotsActionsTest-193655122 None] Create snapshot completed successfully Aug 13 09:26:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Acquiring lock "cinder-598c1e10-f3d6-4ca6-bf4e-12b11135a57c-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-598c1e10-f3d6-4ca6-bf4e-12b11135a57c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Acquiring lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Acquiring lock "cinder-quobyte-598c1e10-f3d6-4ca6-bf4e-12b11135a57c" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-598c1e10-f3d6-4ca6-bf4e-12b11135a57c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Deleting offline snapshot 598c1e10-f3d6-4ca6-bf4e-12b11135a57c of volume 9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:26:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] snapshot_file for this snap is: volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:26:48 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf52e4f-a966-4b54-8637-879d8657cc61]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:48 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c Aug 13 09:26:48 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:48 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Flow 'volume_create_manager' (e77e833f-663a-4c6b-9da7-de4e545d00b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcadc4a7-765a-4fd7-81d2-ae57fb94aa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcadc4a7-765a-4fd7-81d2-ae57fb94aa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-211388923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c14b1b7-1497-429a-9477-033c21f0b2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4263007e2b814b038e74a0eb05eca6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:49Z,use_quota=True,user_id='270b6c51ba3e477fb70ad627beec618c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0383676-3ad6-4448-870b-2b03dcfb6482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0383676-3ad6-4448-870b-2b03dcfb6482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73145f19-9dfb-4e76-a696-4307f51f1777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG cinder.image.glance [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Creating Keystone auth plugin from conf {{(pid=94670) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 13 09:26:49 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c" returned: 0 in 0.542s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5801d80-a764-4804-8f7c-d3ad9218c9ca]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:49 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 Aug 13 09:26:49 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73145f19-9dfb-4e76-a696-4307f51f1777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c14b1b7-1497-429a-9477-033c21f0b2bd', 'volume_name': 'volume-1c14b1b7-1497-429a-9477-033c21f0b2bd', 'volume_size': 1, 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3c2349994ac4b0198f93975c909efdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'created_at': datetime.datetime(2026, 8, 13, 7, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 15, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1330bb5-9d27-4913-888d-485e4ed28bd9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c828cd4-4e8d-4140-b02c-f0cf45106e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c828cd4-4e8d-4140-b02c-f0cf45106e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d83e44-f135-4550-bed3-c33fb3ce65ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:49 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Volume 1c14b1b7-1497-429a-9477-033c21f0b2bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c14b1b7-1497-429a-9477-033c21f0b2bd', 'volume_size': 1, 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3c2349994ac4b0198f93975c909efdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'created_at': datetime.datetime(2026, 8, 13, 7, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 15, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1330bb5-9d27-4913-888d-485e4ed28bd9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Trying to clone 1c14b1b7-1497-429a-9477-033c21f0b2bd from image b1330bb5-9d27-4913-888d-485e4ed28bd9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]). {{(pid=94670) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 13 09:26:49 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8" returned: 0 in 0.511s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:26:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:49 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c Aug 13 09:26:49 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:50 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_cbaddkgjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 13 09:26:50 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Image download 20.69 MB at 20.69 MB/s Aug 13 09:26:50 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc1d8d6-15f7-4b05-baab-42d78a94ef84]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_cbaddkgjdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:50 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c" returned: 0 in 0.691s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:50 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_cbaddkgjdevstack@QuobyteHD Aug 13 09:26:50 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:50 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c Aug 13 09:26:50 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:50 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.598c1e10-f3d6-4ca6-bf4e-12b11135a57c" returned: 0 in 0.293s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-598c1e10-f3d6-4ca6-bf4e-12b11135a57c" released by "_delete_snapshot" :: held 2.187s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:50 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" released by "delete_snapshot" :: held 2.219s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_cbaddkgjdevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:50 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Temporary image b1330bb5-9d27-4913-888d-485e4ed28bd9 is fetched for user 270b6c51ba3e477fb70ad627beec618c. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 13 09:26:50 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Created reservations ['00b7ff9b-0ec1-4334-a7d5-faa49ef6611a', 'a46a2597-e85b-47a8-94fb-38f19fcfd95b', 'c3bd2278-c69b-4b1b-bc35-4c4c356c7deb', 'dbcc1f4d-aaa3-4f05-a868-175d39b8274c'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:26:50 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[129f93e9-e278-44e6-b55f-ff3862cfd9cd]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_cbaddkgjdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:50 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Delete snapshot completed successfully. Aug 13 09:26:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7959e3da-3ca2-4c59-932f-a769797c84ae tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-598c1e10-f3d6-4ca6-bf4e-12b11135a57c-delete_snapshot" released by "delete_snapshot" :: held 2.448s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:50 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_cbaddkgjdevstack@QuobyteHD Aug 13 09:26:50 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:51 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_cbaddkgjdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-211388923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c14b1b7-1497-429a-9477-033c21f0b2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4263007e2b814b038e74a0eb05eca6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:49Z,use_quota=True,user_id='270b6c51ba3e477fb70ad627beec618c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:26:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Creating volume 1c14b1b7-1497-429a-9477-033c21f0b2bd {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:26:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:26:51 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:26:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:51 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-b9aa7999-2119-44ad-8902-90397de453af req-467cf1f5-f648-4073-8770-9d50cc37c75e tempest-AttachVolumeTestJSON-488212827 None] Terminate volume connection completed successfully. Aug 13 09:26:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-b9aa7999-2119-44ad-8902-90397de453af req-467cf1f5-f648-4073-8770-9d50cc37c75e tempest-AttachVolumeTestJSON-488212827 None] Deleting attachment d73378c5-3ed9-4b96-80b5-204171e05d24. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:26:51 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd 1073741824 Aug 13 09:26:51 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:51 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd 1073741824" returned: 0 in 0.538s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:51 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd Aug 13 09:26:51 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f3021499-7499-4ab8-9e66-d675e4b640de tempest-SnapshotsActionsTest-193655122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:52 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd" returned: 0 in 0.340s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f3021499-7499-4ab8-9e66-d675e4b640de tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.043s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-f3021499-7499-4ab8-9e66-d675e4b640de tempest-SnapshotsActionsTest-193655122 None] Creating offline snapshot ba4109ff-7fcd-4737-b629-f95aed478385 of volume 9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Attempting download of b1330bb5-9d27-4913-888d-485e4ed28bd9 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}])) to volume 1c14b1b7-1497-429a-9477-033c21f0b2bd. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0148d523-f6c9-4a13-857e-aaddd31c347b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3021499-7499-4ab8-9e66-d675e4b640de tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d0a4e1-9376-4a5c-9b87-964f04974c22]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_ywtgenqc {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:52 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 Aug 13 09:26:52 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:52 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_ywtgenqc Aug 13 09:26:52 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:52 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3021499-7499-4ab8-9e66-d675e4b640de tempest-SnapshotsActionsTest-193655122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8" returned: 0 in 0.399s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-f3021499-7499-4ab8-9e66-d675e4b640de tempest-SnapshotsActionsTest-193655122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3021499-7499-4ab8-9e66-d675e4b640de tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:52 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385 1G Aug 13 09:26:52 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:52 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_ywtgenqc" returned: 0 in 0.368s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_ywtgenqc {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:52 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_ywtgenqc Aug 13 09:26:52 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:53 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_ywtgenqc" returned: 1 in 0.356s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_ywtgenqc' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:26:53 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[df450204-44ee-4508-a584-1ecae7389ef7]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_cbaddkgjdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:53 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:53 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_cbaddkgjdevstack@QuobyteHD Aug 13 09:26:53 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3021499-7499-4ab8-9e66-d675e4b640de tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385 1G" returned: 0 in 0.561s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3021499-7499-4ab8-9e66-d675e4b640de tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:53 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385 Aug 13 09:26:53 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:53 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_cbaddkgjdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:53 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] b1330bb5-9d27-4913-888d-485e4ed28bd9 was qcow2, converting to raw {{(pid=94670) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 13 09:26:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_cbaddkgjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:53 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_cbaddkgjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd Aug 13 09:26:53 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:53 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3021499-7499-4ab8-9e66-d675e4b640de tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385" returned: 0 in 0.363s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:53 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-f3021499-7499-4ab8-9e66-d675e4b640de tempest-SnapshotsActionsTest-193655122 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385 is being set with open permissions: ugo+rw Aug 13 09:26:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3021499-7499-4ab8-9e66-d675e4b640de tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:53 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385 Aug 13 09:26:53 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:53 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3021499-7499-4ab8-9e66-d675e4b640de tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385" returned: 0 in 0.326s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f3021499-7499-4ab8-9e66-d675e4b640de tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:54 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-f3021499-7499-4ab8-9e66-d675e4b640de tempest-SnapshotsActionsTest-193655122 None] Create snapshot completed successfully Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Acquiring lock "cinder-ba4109ff-7fcd-4737-b629-f95aed478385-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-ba4109ff-7fcd-4737-b629-f95aed478385-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Acquiring lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Acquiring lock "cinder-quobyte-ba4109ff-7fcd-4737-b629-f95aed478385" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-ba4109ff-7fcd-4737-b629-f95aed478385" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Deleting offline snapshot ba4109ff-7fcd-4737-b629-f95aed478385 of volume 9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] snapshot_file for this snap is: volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea99090-6b21-4c08-8d93-e9b8ce7793df]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Flow 'volume_create_manager' (d266eae8-aae0-4749-ab7d-87c1d22b0abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd12c31a-f863-4566-ab49-200c975db4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd12c31a-f863-4566-ab49-200c975db4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1193592674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7f4734-786a-400d-b10e-29070eb3f774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8c072fd5324bd4933a219681a72c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:55Z,use_quota=True,user_id='df5fe29642ed4ee3b51d478f168b8478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb129148-3230-4076-aa8f-e056147d3e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb129148-3230-4076-aa8f-e056147d3e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea11cc49-b498-412f-a5d7-42ce248d6860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea11cc49-b498-412f-a5d7-42ce248d6860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7f4734-786a-400d-b10e-29070eb3f774', 'volume_name': 'volume-7a7f4734-786a-400d-b10e-29070eb3f774', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:54 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385 Aug 13 09:26:54 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebef99b-e3a5-42d1-a2ae-a748d7d36c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebef99b-e3a5-42d1-a2ae-a748d7d36c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58fdca9-d0ea-4560-b54b-8b8538410bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:54 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Volume 7a7f4734-786a-400d-b10e-29070eb3f774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7f4734-786a-400d-b10e-29070eb3f774', 'volume_size': 1} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1193592674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7f4734-786a-400d-b10e-29070eb3f774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8c072fd5324bd4933a219681a72c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:26:55Z,use_quota=True,user_id='df5fe29642ed4ee3b51d478f168b8478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Creating volume 7a7f4734-786a-400d-b10e-29070eb3f774 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:26:54 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:26:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7f4734-786a-400d-b10e-29070eb3f774 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:54 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7f4734-786a-400d-b10e-29070eb3f774 1073741824 Aug 13 09:26:54 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:55 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385" returned: 0 in 0.639s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[659d2817-e30f-4c99-af6c-20c14de6ae81]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:55 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 Aug 13 09:26:55 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:55 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7f4734-786a-400d-b10e-29070eb3f774 1073741824" returned: 0 in 0.727s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7f4734-786a-400d-b10e-29070eb3f774 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:55 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7f4734-786a-400d-b10e-29070eb3f774 Aug 13 09:26:55 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:55 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_cbaddkgjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd" returned: 0 in 2.306s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_cbaddkgjdevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:26:55 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Converted 112.00 MB image at 48.51 MB/s Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:55 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd 1G Aug 13 09:26:55 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:55 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7f4734-786a-400d-b10e-29070eb3f774" returned: 0 in 0.292s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:55 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58fdca9-d0ea-4560-b54b-8b8538410bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7f4734-786a-400d-b10e-29070eb3f774', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7274cad-8fc1-4058-b8e7-93d0622a7a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8" returned: 0 in 0.652s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:55 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Volume volume-7a7f4734-786a-400d-b10e-29070eb3f774 (7a7f4734-786a-400d-b10e-29070eb3f774): created successfully Aug 13 09:26:55 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385 Aug 13 09:26:55 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7274cad-8fc1-4058-b8e7-93d0622a7a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Flow 'volume_create_manager' (d266eae8-aae0-4749-ab7d-87c1d22b0abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:56 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-da6c0ce1-d078-440b-837f-ecacba02df8d tempest-VolumeQuotasAdminTestJSON-1716799477 None] Created volume successfully. Aug 13 09:26:56 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd 1G" returned: 0 in 0.480s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:56 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[44227f3f-a747-4023-a79d-c214be452e69]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:56 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd Aug 13 09:26:56 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:56 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385" returned: 0 in 0.795s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:56 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385 Aug 13 09:26:56 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Acquiring lock "cinder-7a7f4734-786a-400d-b10e-29070eb3f774-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:57 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd" returned: 0 in 0.746s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Lock "cinder-7a7f4734-786a-400d-b10e-29070eb3f774-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Acquiring lock "cinder-quobyte-7a7f4734-786a-400d-b10e-29070eb3f774" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Lock "cinder-quobyte-7a7f4734-786a-400d-b10e-29070eb3f774" acquired by "delete_volume" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[311657dc-ca02-4b99-ade7-35a6095e4bc3]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7f4734-786a-400d-b10e-29070eb3f774 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:57 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.ba4109ff-7fcd-4737-b629-f95aed478385" returned: 0 in 0.591s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:57 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd Aug 13 09:26:57 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-ba4109ff-7fcd-4737-b629-f95aed478385" released by "_delete_snapshot" :: held 2.832s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" released by "delete_snapshot" :: held 2.872s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:57 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7f4734-786a-400d-b10e-29070eb3f774 Aug 13 09:26:57 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Created reservations ['e9367819-df30-42f5-9ef2-0f4243827d83', 'bfb7f6a6-fe25-4897-800b-c864cfb93db9', 'a440b0e6-1da0-494b-bf39-eb57567ba890', '2ce4a079-ddee-4618-8b32-c28ac16157d8'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:26:57 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Delete snapshot completed successfully. Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-767304cf-45df-43bc-963f-0e763911a9bf tempest-SnapshotsActionsTest-2013761282 None] Lock "cinder-ba4109ff-7fcd-4737-b629-f95aed478385-delete_snapshot" released by "delete_snapshot" :: held 3.142s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:57 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd" returned: 1 in 0.678s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Downloaded image b1330bb5-9d27-4913-888d-485e4ed28bd9 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}])) to volume 1c14b1b7-1497-429a-9477-033c21f0b2bd successfully. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Temporary image b1330bb5-9d27-4913-888d-485e4ed28bd9 for user 270b6c51ba3e477fb70ad627beec618c is deleted. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Marking volume 1c14b1b7-1497-429a-9477-033c21f0b2bd as bootable. {{(pid=94670) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Copying metadata from image b1330bb5-9d27-4913-888d-485e4ed28bd9 to 1c14b1b7-1497-429a-9477-033c21f0b2bd. {{(pid=94670) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Creating volume glance metadata for volume 1c14b1b7-1497-429a-9477-033c21f0b2bd backed by image b1330bb5-9d27-4913-888d-485e4ed28bd9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94670) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 13 09:26:57 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7f4734-786a-400d-b10e-29070eb3f774" returned: 0 in 0.544s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7f4734-786a-400d-b10e-29070eb3f774 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:57 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7f4734-786a-400d-b10e-29070eb3f774 Aug 13 09:26:57 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d83e44-f135-4550-bed3-c33fb3ce65ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c14b1b7-1497-429a-9477-033c21f0b2bd', 'volume_size': 1, 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3c2349994ac4b0198f93975c909efdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'created_at': datetime.datetime(2026, 8, 13, 7, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 15, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1330bb5-9d27-4913-888d-485e4ed28bd9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d6f2f3-8b76-4f74-aed1-66204ff42948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:26:58 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Volume volume-1c14b1b7-1497-429a-9477-033c21f0b2bd (1c14b1b7-1497-429a-9477-033c21f0b2bd): created successfully Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d6f2f3-8b76-4f74-aed1-66204ff42948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Flow 'volume_create_manager' (e77e833f-663a-4c6b-9da7-de4e545d00b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:26:58 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-adfd4dad-05dd-4b14-981c-699f2ddd1a31 tempest-VolumesImageMetadata-2113909882 None] Created volume successfully. Aug 13 09:26:58 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7f4734-786a-400d-b10e-29070eb3f774" returned: 0 in 0.376s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Lock "cinder-quobyte-7a7f4734-786a-400d-b10e-29070eb3f774" released by "delete_volume" :: held 0.983s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Created reservations ['557bd389-23ac-421e-8efd-2fb3fb691e8a', '59524e74-16ea-4141-86f9-893591b804b2', 'bdbf66a7-e720-4850-a5d2-513feca058e2', '38c99460-0847-4650-83bc-3b8025b1f2d0'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Acquiring lock "cinder-631e02ae-728a-43a1-838f-350d972501f8-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:58 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:26:58 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Lock "cinder-631e02ae-728a-43a1-838f-350d972501f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Acquiring lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Acquiring lock "cinder-quobyte-631e02ae-728a-43a1-838f-350d972501f8" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Lock "cinder-quobyte-631e02ae-728a-43a1-838f-350d972501f8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Deleting offline snapshot 631e02ae-728a-43a1-838f-350d972501f8 of volume 9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] snapshot_file for this snap is: volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[967e0d8a-276b-4fd0-b403-19980f7e9071]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:58 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 Aug 13 09:26:58 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:58 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.334s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:26:58 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Deleted volume successfully. Aug 13 09:26:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-78489fd4-f3c3-4b99-9455-07081e2a3875 tempest-VolumeQuotasAdminTestJSON-1716799477 None] Lock "cinder-7a7f4734-786a-400d-b10e-29070eb3f774-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:26:59 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8" returned: 0 in 0.546s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:26:59 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[436fa454-64e7-466c-818b-0af6cf94a75f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:59 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 Aug 13 09:26:59 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:59 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Acquiring lock "cinder-1c14b1b7-1497-429a-9477-033c21f0b2bd-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:59 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Lock "cinder-1c14b1b7-1497-429a-9477-033c21f0b2bd-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:59 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Acquiring lock "cinder-quobyte-1c14b1b7-1497-429a-9477-033c21f0b2bd" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:26:59 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Lock "cinder-quobyte-1c14b1b7-1497-429a-9477-033c21f0b2bd" acquired by "delete_volume" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:26:59 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[8428cd27-1401-46b1-8728-7ed10fb28d68]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:26:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:59 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Aug 13 09:26:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827" returned: 0 in 0.585s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:26:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:26:59 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 Aug 13 09:26:59 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:26:59 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd Aug 13 09:26:59 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Flow 'volume_create_manager' (a9eae027-ce77-4d52-9617-3004e6fc2764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535341b9-f7d3-4ede-9139-8c3d335d5601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535341b9-f7d3-4ede-9139-8c3d335d5601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1871945120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8b136d-4872-4954-beb8-73c147cf9e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8c072fd5324bd4933a219681a72c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:00Z,use_quota=True,user_id='df5fe29642ed4ee3b51d478f168b8478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90106341-0612-4a96-9c22-cc0e87b04e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90106341-0612-4a96-9c22-cc0e87b04e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c965fb8a-3f08-4b99-9b41-565561c97e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:00 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c965fb8a-3f08-4b99-9b41-565561c97e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb8b136d-4872-4954-beb8-73c147cf9e4c', 'volume_name': 'volume-cb8b136d-4872-4954-beb8-73c147cf9e4c', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f77a207-bbaa-4ecf-9472-5d96e10e4db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f77a207-bbaa-4ecf-9472-5d96e10e4db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d61ecb-4a77-4c3f-97b5-f0d9e30d6f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:00 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Volume cb8b136d-4872-4954-beb8-73c147cf9e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb8b136d-4872-4954-beb8-73c147cf9e4c', 'volume_size': 1} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:00 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1871945120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8b136d-4872-4954-beb8-73c147cf9e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8c072fd5324bd4933a219681a72c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:00Z,use_quota=True,user_id='df5fe29642ed4ee3b51d478f168b8478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Creating volume cb8b136d-4872-4954-beb8-73c147cf9e4c {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:27:00 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb8b136d-4872-4954-beb8-73c147cf9e4c 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8" returned: 0 in 0.533s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd" returned: 0 in 0.626s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:00 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb8b136d-4872-4954-beb8-73c147cf9e4c 1073741824 Aug 13 09:27:00 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:00 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8 Aug 13 09:27:00 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:00 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd Aug 13 09:27:00 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:00 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827.631e02ae-728a-43a1-838f-350d972501f8" returned: 0 in 0.390s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:00 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd" returned: 1 in 0.433s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Lock "cinder-quobyte-631e02ae-728a-43a1-838f-350d972501f8" released by "_delete_snapshot" :: held 2.212s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" released by "delete_snapshot" :: held 2.249s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:00 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd Aug 13 09:27:00 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:00 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb8b136d-4872-4954-beb8-73c147cf9e4c 1073741824" returned: 0 in 0.515s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb8b136d-4872-4954-beb8-73c147cf9e4c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Created reservations ['0d2a9b41-a9bb-4e30-948b-ef0e2e485c9f', '17b02a90-013f-4aa5-afd0-90142b8b5e32', 'f5be7e8f-d1e9-4574-a787-2cbf16d27c09', 'cefd92a8-4449-4344-ab65-2bd353062837'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:27:00 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb8b136d-4872-4954-beb8-73c147cf9e4c Aug 13 09:27:00 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:00 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Delete snapshot completed successfully. Aug 13 09:27:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1b6a2e28-1a3b-47e3-9231-9c356c202a06 tempest-SnapshotsActionsTest-193655122 None] Lock "cinder-631e02ae-728a-43a1-838f-350d972501f8-delete_snapshot" released by "delete_snapshot" :: held 2.463s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:01 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1c14b1b7-1497-429a-9477-033c21f0b2bd" returned: 0 in 0.309s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Lock "cinder-quobyte-1c14b1b7-1497-429a-9477-033c21f0b2bd" released by "delete_volume" :: held 1.463s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Created reservations ['58143ed8-e19c-42f0-aab8-943035e9b368', '4ff19b70-edff-4d39-bcb0-0878d115a215', 'c2bff6bb-857b-4159-92f0-fdd08ccda55d', 'aac6b281-dfa7-4e4f-9991-20e300fcfa72'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:27:01 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb8b136d-4872-4954-beb8-73c147cf9e4c" returned: 0 in 0.327s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d61ecb-4a77-4c3f-97b5-f0d9e30d6f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb8b136d-4872-4954-beb8-73c147cf9e4c', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868920dd-e0a1-4acf-8327-a93c8e37b7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:01 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Volume volume-cb8b136d-4872-4954-beb8-73c147cf9e4c (cb8b136d-4872-4954-beb8-73c147cf9e4c): created successfully Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868920dd-e0a1-4acf-8327-a93c8e37b7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Flow 'volume_create_manager' (a9eae027-ce77-4d52-9617-3004e6fc2764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:01 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-fb098472-bb7b-4cfd-8322-9e748133febf tempest-VolumeQuotasAdminTestJSON-1716799477 None] Created volume successfully. Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:01 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:27:01 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:01 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.265s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:27:01 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Deleted volume successfully. Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c452b8d3-f881-42b6-8135-fd17e73b7abf tempest-VolumesImageMetadata-2113909882 None] Lock "cinder-1c14b1b7-1497-429a-9477-033c21f0b2bd-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Acquiring lock "cinder-9d764896-5ae9-48a1-b78b-70c1dc3c6827-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Lock "cinder-9d764896-5ae9-48a1-b78b-70c1dc3c6827-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Acquiring lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[886a1ae8-2a48-4bf0-87b3-b82dffef8a03]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:02 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 Aug 13 09:27:02 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:02 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827" returned: 0 in 0.429s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:02 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827 Aug 13 09:27:02 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:02 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9d764896-5ae9-48a1-b78b-70c1dc3c6827" returned: 0 in 0.321s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Lock "cinder-quobyte-9d764896-5ae9-48a1-b78b-70c1dc3c6827" released by "delete_volume" :: held 0.837s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:02 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Created reservations ['f48fa30b-9db6-4df0-a96f-9404238b62a0', 'f04147db-29a0-463e-84b0-5324c643a333', '49034e8b-30a5-4ead-9c5b-92ae992d4714', 'a0f54371-6193-4fab-9f91-7b0a6c7f491a'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:27:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:02 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:27:02 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:03 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.317s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:03 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:27:03 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Deleted volume successfully. Aug 13 09:27:03 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5dcbeed2-04ad-4bb0-8fb1-b63e471e5b11 tempest-SnapshotsActionsTest-193655122 None] Lock "cinder-9d764896-5ae9-48a1-b78b-70c1dc3c6827-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:03 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-a951a37d-e180-4b49-9bb4-6c0e0a96507e tempest-VolumeQuotasAdminTestJSON-78092593 None] Transfer volume completed successfully. Aug 13 09:27:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Acquiring lock "cinder-cb8b136d-4872-4954-beb8-73c147cf9e4c-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Lock "cinder-cb8b136d-4872-4954-beb8-73c147cf9e4c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Acquiring lock "cinder-quobyte-cb8b136d-4872-4954-beb8-73c147cf9e4c" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Lock "cinder-quobyte-cb8b136d-4872-4954-beb8-73c147cf9e4c" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:04 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af801a3-4967-4615-a090-1f556f3666e9]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb8b136d-4872-4954-beb8-73c147cf9e4c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:04 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb8b136d-4872-4954-beb8-73c147cf9e4c Aug 13 09:27:04 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:04 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb8b136d-4872-4954-beb8-73c147cf9e4c" returned: 0 in 0.399s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb8b136d-4872-4954-beb8-73c147cf9e4c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:04 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb8b136d-4872-4954-beb8-73c147cf9e4c Aug 13 09:27:04 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:05 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb8b136d-4872-4954-beb8-73c147cf9e4c" returned: 0 in 0.286s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Lock "cinder-quobyte-cb8b136d-4872-4954-beb8-73c147cf9e4c" released by "delete_volume" :: held 0.728s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:05 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Created reservations ['7c89b148-baeb-45aa-a001-16d48f97cf69', 'e4803108-d682-45a8-9f6d-55b82a21fc4d', 'da74f96f-1921-41bf-99a2-542e93ee1889', '88c38eb3-a1e5-4b86-83ee-80249a1077e9'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:27:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:05 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:27:05 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:06 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.285s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:06 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:27:06 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Deleted volume successfully. Aug 13 09:27:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-42eca2ed-99a4-4927-ac66-f8fd49372fbf tempest-VolumeQuotasAdminTestJSON-1116596803 None] Lock "cinder-cb8b136d-4872-4954-beb8-73c147cf9e4c-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Flow 'volume_create_manager' (83a76205-9afc-4f4c-b4a2-877b17429b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc75ea8d-a801-4cb0-9345-7462006318ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc75ea8d-a801-4cb0-9345-7462006318ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1094620525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e24e397d-1ad9-4cdd-80ab-707f62d6f568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2716280c1a67425f8def884d84a78d7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:07Z,use_quota=True,user_id='468302b124284cebb2bdc8e108b2b9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb675ed9-b064-42a8-935d-d9b05651138a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb675ed9-b064-42a8-935d-d9b05651138a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dcc895-85de-40c0-81db-23749334a459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dcc895-85de-40c0-81db-23749334a459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e24e397d-1ad9-4cdd-80ab-707f62d6f568', 'volume_name': 'volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be36768b-b2cd-4abc-9d96-a478e09528df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be36768b-b2cd-4abc-9d96-a478e09528df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d0a3a5-e9e7-43d3-bdf3-5a9c2fbc457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:07 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Volume e24e397d-1ad9-4cdd-80ab-707f62d6f568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568', 'volume_size': 1} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1094620525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e24e397d-1ad9-4cdd-80ab-707f62d6f568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2716280c1a67425f8def884d84a78d7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:07Z,use_quota=True,user_id='468302b124284cebb2bdc8e108b2b9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Creating volume e24e397d-1ad9-4cdd-80ab-707f62d6f568 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:27:07 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:27:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:07 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 1073741824 Aug 13 09:27:07 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:08 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 1073741824" returned: 0 in 0.479s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:08 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 Aug 13 09:27:08 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:08 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568" returned: 0 in 0.276s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:27:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d0a3a5-e9e7-43d3-bdf3-5a9c2fbc457b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e0cbcf-365d-441a-a3a1-eeb1c2c7572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:09 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Volume volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 (e24e397d-1ad9-4cdd-80ab-707f62d6f568): created successfully Aug 13 09:27:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e0cbcf-365d-441a-a3a1-eeb1c2c7572c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Flow 'volume_create_manager' (83a76205-9afc-4f4c-b4a2-877b17429b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:09 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-7ebedf3d-53be-46b1-819f-319362eb1d7d tempest-VolumesDeleteCascade-1263478308 None] Created volume successfully. Aug 13 09:27:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:11 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] Creating offline snapshot 89fd47db-4de9-4c38-aeed-f9c32bf490a1 of volume e24e397d-1ad9-4cdd-80ab-707f62d6f568 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:27:11 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[31640b17-338a-427a-a4bf-2ff5c75de3de]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:11 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 Aug 13 09:27:11 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:11 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568" returned: 0 in 0.473s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:11 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 1G Aug 13 09:27:11 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:12 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 1G" returned: 0 in 0.546s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:12 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 Aug 13 09:27:12 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:12 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1" returned: 0 in 0.357s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:12 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 is being set with open permissions: ugo+rw Aug 13 09:27:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:12 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 Aug 13 09:27:12 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:12 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1" returned: 0 in 0.268s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:12 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=174,cinder:SELECT=134,cinder:INSERT=38,cinder:DELETE=15 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:27:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:12 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.info Aug 13 09:27:12 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:13 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.info" returned: 0 in 0.379s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:13 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.info is being set with open permissions: ugo+rw Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:13 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.info Aug 13 09:27:13 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Flow 'volume_create_manager' (ad3000e9-ee85-41ed-95d4-cdb75464ae72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321107b4-41f6-4a22-965c-a3d2d8d4b2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=139,cinder:INSERT=54,cinder:UPDATE=155,cinder:DELETE=14 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321107b4-41f6-4a22-965c-a3d2d8d4b2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1098204340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00648325-7318-4b76-add9-6e5936c72b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56188f9f869f455fa433e706ec269687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:13Z,use_quota=True,user_id='da53951a1e244242b5ec12a15dd42269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec9d322-32f5-4692-9044-a0f75d1ea6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec9d322-32f5-4692-9044-a0f75d1ea6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c135a255-71f0-4c6d-aca2-9c9dd76ff165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c135a255-71f0-4c6d-aca2-9c9dd76ff165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00648325-7318-4b76-add9-6e5936c72b7f', 'volume_name': 'volume-00648325-7318-4b76-add9-6e5936c72b7f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d229de10-2b21-4643-804f-e54db54084fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d229de10-2b21-4643-804f-e54db54084fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd541dea-b18d-4fd2-ad45-660d8fae8b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:13 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Volume 00648325-7318-4b76-add9-6e5936c72b7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00648325-7318-4b76-add9-6e5936c72b7f', 'volume_size': 1} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:13 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.info" returned: 0 in 0.273s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.425s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.135s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1098204340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00648325-7318-4b76-add9-6e5936c72b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56188f9f869f455fa433e706ec269687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:13Z,use_quota=True,user_id='da53951a1e244242b5ec12a15dd42269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Creating volume 00648325-7318-4b76-add9-6e5936c72b7f {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:27:13 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-00648325-7318-4b76-add9-6e5936c72b7f 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:13 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-00648325-7318-4b76-add9-6e5936c72b7f 1073741824 Aug 13 09:27:13 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:13 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-128bacc0-1a0d-4003-b082-d22a833f1d6e tempest-VolumesDeleteCascade-1263478308 None] Create snapshot completed successfully Aug 13 09:27:13 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-00648325-7318-4b76-add9-6e5936c72b7f 1073741824" returned: 0 in 0.512s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-00648325-7318-4b76-add9-6e5936c72b7f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:13 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-00648325-7318-4b76-add9-6e5936c72b7f Aug 13 09:27:13 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:14 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-00648325-7318-4b76-add9-6e5936c72b7f" returned: 0 in 0.283s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:27:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd541dea-b18d-4fd2-ad45-660d8fae8b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00648325-7318-4b76-add9-6e5936c72b7f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54f1b16-a98f-4893-a670-d0a672f62ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:14 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Volume volume-00648325-7318-4b76-add9-6e5936c72b7f (00648325-7318-4b76-add9-6e5936c72b7f): created successfully Aug 13 09:27:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54f1b16-a98f-4893-a670-d0a672f62ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Flow 'volume_create_manager' (ad3000e9-ee85-41ed-95d4-cdb75464ae72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:14 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-93ec3e23-f369-45f2-bcfa-d704f29eaff6 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Created volume successfully. Aug 13 09:27:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bcc515b7-52aa-428d-9b62-e54da1301fa3 tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bcc515b7-52aa-428d-9b62-e54da1301fa3 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-bcc515b7-52aa-428d-9b62-e54da1301fa3 tempest-VolumesDeleteCascade-1263478308 None] Creating offline snapshot 9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 of volume e24e397d-1ad9-4cdd-80ab-707f62d6f568 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:27:14 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74f8d55-72ba-4e6f-9888-6a1e1ac32b91]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bcc515b7-52aa-428d-9b62-e54da1301fa3 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:14 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 Aug 13 09:27:14 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:14 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bcc515b7-52aa-428d-9b62-e54da1301fa3 tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1" returned: 0 in 0.372s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-bcc515b7-52aa-428d-9b62-e54da1301fa3 tempest-VolumesDeleteCascade-1263478308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:27:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bcc515b7-52aa-428d-9b62-e54da1301fa3 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:14 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 1G Aug 13 09:27:14 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:15 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bcc515b7-52aa-428d-9b62-e54da1301fa3 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 1G" returned: 0 in 0.458s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bcc515b7-52aa-428d-9b62-e54da1301fa3 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:15 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 Aug 13 09:27:15 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:15 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bcc515b7-52aa-428d-9b62-e54da1301fa3 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4" returned: 0 in 0.329s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:15 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-bcc515b7-52aa-428d-9b62-e54da1301fa3 tempest-VolumesDeleteCascade-1263478308 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 is being set with open permissions: ugo+rw Aug 13 09:27:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bcc515b7-52aa-428d-9b62-e54da1301fa3 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:15 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 Aug 13 09:27:15 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:15 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bcc515b7-52aa-428d-9b62-e54da1301fa3 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4" returned: 0 in 0.273s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bcc515b7-52aa-428d-9b62-e54da1301fa3 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.537s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:15 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-bcc515b7-52aa-428d-9b62-e54da1301fa3 tempest-VolumesDeleteCascade-1263478308 None] Create snapshot completed successfully Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Acquiring lock "cinder-00648325-7318-4b76-add9-6e5936c72b7f-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Lock "cinder-00648325-7318-4b76-add9-6e5936c72b7f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Acquiring lock "cinder-quobyte-00648325-7318-4b76-add9-6e5936c72b7f" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Lock "cinder-quobyte-00648325-7318-4b76-add9-6e5936c72b7f" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46f05bb-2061-4ee7-98b2-d45f235fe8d6]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-00648325-7318-4b76-add9-6e5936c72b7f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:16 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-00648325-7318-4b76-add9-6e5936c72b7f Aug 13 09:27:16 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-e24e397d-1ad9-4cdd-80ab-707f62d6f568-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-e24e397d-1ad9-4cdd-80ab-707f62d6f568-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Flow 'volume_create_manager' (52f2b9d0-8137-48fb-9376-fccb2eff0477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384a9b2f-d864-4b54-a43e-963c49fecc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Performing cascade delete. {{(pid=94670) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384a9b2f-d864-4b54-a43e-963c49fecc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-878362440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307f18ba-a4b3-419c-9958-db6d0ea6625c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6abd02aabe4f4fbda251cd5bc2d9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:16Z,use_quota=True,user_id='43c4b2d709df490aa33632bc28f3dc4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ee5ca08-a385-406d-bf77-bfdd95342920),volume_type_id=3ee5ca08-a385-406d-bf77-bfdd95342920)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb45a42-05ce-4707-a7b0-7b77fbf8f5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb45a42-05ce-4707-a7b0-7b77fbf8f5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ebade3-aa53-4ef2-9c2f-49bae6c1d4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ebade3-aa53-4ef2-9c2f-49bae6c1d4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '307f18ba-a4b3-419c-9958-db6d0ea6625c', 'volume_name': 'volume-307f18ba-a4b3-419c-9958-db6d0ea6625c', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f9db3c-66a8-4565-993d-03acbf51626b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f9db3c-66a8-4565-993d-03acbf51626b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528d3638-05a4-484e-a142-905be8def13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:16 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Volume 307f18ba-a4b3-419c-9958-db6d0ea6625c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-307f18ba-a4b3-419c-9958-db6d0ea6625c', 'volume_size': 1} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-878362440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307f18ba-a4b3-419c-9958-db6d0ea6625c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6abd02aabe4f4fbda251cd5bc2d9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:16Z,use_quota=True,user_id='43c4b2d709df490aa33632bc28f3dc4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ee5ca08-a385-406d-bf77-bfdd95342920),volume_type_id=3ee5ca08-a385-406d-bf77-bfdd95342920)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Creating volume 307f18ba-a4b3-419c-9958-db6d0ea6625c {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:27:16 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-307f18ba-a4b3-419c-9958-db6d0ea6625c 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-89fd47db-4de9-4c38-aeed-f9c32bf490a1-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:16 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-307f18ba-a4b3-419c-9958-db6d0ea6625c 1073741824 Aug 13 09:27:16 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-89fd47db-4de9-4c38-aeed-f9c32bf490a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-quobyte-e24e397d-1ad9-4cdd-80ab-707f62d6f568" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-e24e397d-1ad9-4cdd-80ab-707f62d6f568" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-quobyte-89fd47db-4de9-4c38-aeed-f9c32bf490a1" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-89fd47db-4de9-4c38-aeed-f9c32bf490a1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Deleting offline snapshot 89fd47db-4de9-4c38-aeed-f9c32bf490a1 of volume e24e397d-1ad9-4cdd-80ab-707f62d6f568 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] snapshot_file for this snap is: volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90fa176-bc1d-4a8a-8944-5f62a49b7b4f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:16 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-00648325-7318-4b76-add9-6e5936c72b7f" returned: 0 in 0.502s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-00648325-7318-4b76-add9-6e5936c72b7f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:16 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-00648325-7318-4b76-add9-6e5936c72b7f Aug 13 09:27:16 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:17 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 Aug 13 09:27:17 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:17 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-00648325-7318-4b76-add9-6e5936c72b7f" returned: 0 in 0.365s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Lock "cinder-quobyte-00648325-7318-4b76-add9-6e5936c72b7f" released by "delete_volume" :: held 0.926s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:17 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1" returned: 0 in 0.464s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Created reservations ['4d825c7c-bf44-4674-a5fb-b38d198a2886', 'c09fe80e-4713-4e4f-8847-7b71521d0af8', '92e9b648-f1ce-4a7a-8802-fb14e7dc7ca8', '3ff8f570-90af-45af-9177-4f5d089decf8'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:27:17 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d4778e-c4a5-40af-bec2-321fe434b28c]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-307f18ba-a4b3-419c-9958-db6d0ea6625c 1073741824" returned: 0 in 0.688s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-307f18ba-a4b3-419c-9958-db6d0ea6625c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:17 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-307f18ba-a4b3-419c-9958-db6d0ea6625c Aug 13 09:27:17 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:17 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 Aug 13 09:27:17 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:17 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:27:17 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:17 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.285s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:27:17 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Deleted volume successfully. Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-29296915-1cf7-4cb2-8f30-397ba794c352 tempest-VolumeQuotasNegativeTestJSON-1279609127 None] Lock "cinder-00648325-7318-4b76-add9-6e5936c72b7f-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:17 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-307f18ba-a4b3-419c-9958-db6d0ea6625c" returned: 0 in 0.400s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:17 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528d3638-05a4-484e-a142-905be8def13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-307f18ba-a4b3-419c-9958-db6d0ea6625c', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4efb58cf-c0cf-4211-8098-43f981b490a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568" returned: 0 in 0.533s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:17 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Volume volume-307f18ba-a4b3-419c-9958-db6d0ea6625c (307f18ba-a4b3-419c-9958-db6d0ea6625c): created successfully Aug 13 09:27:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4efb58cf-c0cf-4211-8098-43f981b490a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Flow 'volume_create_manager' (52f2b9d0-8137-48fb-9376-fccb2eff0477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:18 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[73085272-1d1c-405a-972a-ecf6c288b5af]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:18 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-2fa5dcdf-ac11-4fd7-95b0-ffa68105b007 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Created volume successfully. Aug 13 09:27:18 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 Aug 13 09:27:18 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:18 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4" returned: 0 in 0.358s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:27:18 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca06e2ae-ca0e-4dfe-8fc6-69f4f774a626]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:18 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 Aug 13 09:27:18 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:18 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1" returned: 0 in 0.399s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:27:18 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d919104-24b7-4cea-946f-e44613375c36]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:18 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 Aug 13 09:27:18 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3efc70a0-0e51-449f-a507-18b0033a73bc tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3efc70a0-0e51-449f-a507-18b0033a73bc tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3efc70a0-0e51-449f-a507-18b0033a73bc tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3efc70a0-0e51-449f-a507-18b0033a73bc tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3efc70a0-0e51-449f-a507-18b0033a73bc tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3efc70a0-0e51-449f-a507-18b0033a73bc tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:19 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:27:19 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:19 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568" returned: 0 in 0.432s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:19 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 Aug 13 09:27:19 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:19 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3efc70a0-0e51-449f-a507-18b0033a73bc tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.282s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:19 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-3efc70a0-0e51-449f-a507-18b0033a73bc tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:27:19 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3efc70a0-0e51-449f-a507-18b0033a73bc tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Retype volume completed successfully. Aug 13 09:27:19 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1" returned: 0 in 0.442s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:19 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1 Aug 13 09:27:19 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:19 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.89fd47db-4de9-4c38-aeed-f9c32bf490a1" returned: 0 in 0.316s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 -F qcow2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:20 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 -F qcow2 Aug 13 09:27:20 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:20 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 -F qcow2" returned: 0 in 0.494s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Acquiring lock "cinder-307f18ba-a4b3-419c-9958-db6d0ea6625c-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-89fd47db-4de9-4c38-aeed-f9c32bf490a1" released by "_delete_snapshot" :: held 3.717s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-e24e397d-1ad9-4cdd-80ab-707f62d6f568" released by "delete_snapshot" :: held 3.766s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Lock "cinder-307f18ba-a4b3-419c-9958-db6d0ea6625c-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Acquiring lock "cinder-quobyte-307f18ba-a4b3-419c-9958-db6d0ea6625c" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Lock "cinder-quobyte-307f18ba-a4b3-419c-9958-db6d0ea6625c" acquired by "delete_volume" :: waited 0.037s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:20 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Created reservations ['e2a80085-a3a4-4a18-902b-fa63e8f0eead', '46ae2e0c-cef3-4b8b-b603-25a0acbdd606', 'cd13f078-4803-4d7b-879b-e798724861bc', 'fb0974a6-6ea9-4c28-84d0-081814bba22e'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:27:20 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5d3ee4-c21e-4b6e-a117-9b616fe5ac1c]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-307f18ba-a4b3-419c-9958-db6d0ea6625c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:20 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Delete snapshot completed successfully. Aug 13 09:27:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-89fd47db-4de9-4c38-aeed-f9c32bf490a1-delete_snapshot" released by "delete_snapshot" :: held 4.139s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-9f5fe08b-244a-4410-aeb4-c0cc41c6abc4-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:20 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-307f18ba-a4b3-419c-9958-db6d0ea6625c Aug 13 09:27:20 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-9f5fe08b-244a-4410-aeb4-c0cc41c6abc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-quobyte-e24e397d-1ad9-4cdd-80ab-707f62d6f568" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-e24e397d-1ad9-4cdd-80ab-707f62d6f568" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-quobyte-9f5fe08b-244a-4410-aeb4-c0cc41c6abc4" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-9f5fe08b-244a-4410-aeb4-c0cc41c6abc4" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Deleting offline snapshot 9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 of volume e24e397d-1ad9-4cdd-80ab-707f62d6f568 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] snapshot_file for this snap is: volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b279b1-531a-4c05-a26a-f5fd1fca3ef7]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:21 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-307f18ba-a4b3-419c-9958-db6d0ea6625c" returned: 0 in 0.475s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-307f18ba-a4b3-419c-9958-db6d0ea6625c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:21 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-307f18ba-a4b3-419c-9958-db6d0ea6625c Aug 13 09:27:21 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:21 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 Aug 13 09:27:21 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:21 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-307f18ba-a4b3-419c-9958-db6d0ea6625c" returned: 0 in 0.458s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Lock "cinder-quobyte-307f18ba-a4b3-419c-9958-db6d0ea6625c" released by "delete_volume" :: held 1.010s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:21 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4" returned: 0 in 0.679s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:27:21 devstack cinder-volume[94670]: WARNING cinder.quota [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:27:21 devstack cinder-volume[94670]: WARNING cinder.quota [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae92f23-0f9d-464a-b61f-1daa7c2cab6e]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:21 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Created reservations ['6c5b2174-ae30-4c71-997c-e56105e2169c', '7ce78eee-599c-472b-a2d8-92f62a9d5831', 'b9a810a8-ed5b-456e-a303-0e7ec1521417', 'e6b555db-08c5-4d0c-abe7-f3f7a1815689'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:27:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:22 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 Aug 13 09:27:22 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:22 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:27:22 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:22 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.344s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:22 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:27:22 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Deleted volume successfully. Aug 13 09:27:22 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568" returned: 0 in 0.565s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6da416d6-b4ae-4188-9aa5-25f3eb789a03 tempest-VolumeRetypeWithoutMigrationTest-1312712595 None] Lock "cinder-307f18ba-a4b3-419c-9958-db6d0ea6625c-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:22 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 Aug 13 09:27:22 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:22 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4" returned: 0 in 0.489s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:22 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4 Aug 13 09:27:22 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:23 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568.9f5fe08b-244a-4410-aeb4-c0cc41c6abc4" returned: 0 in 0.349s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-9f5fe08b-244a-4410-aeb4-c0cc41c6abc4" released by "_delete_snapshot" :: held 2.258s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-e24e397d-1ad9-4cdd-80ab-707f62d6f568" released by "delete_snapshot" :: held 2.303s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:23 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Created reservations ['b20a6a72-a99e-43fd-87a1-ea04707b1877', '225f4b06-e93c-49e7-a584-616b78dd3948', '1f045958-96ab-4aa8-8362-ed00113a30e0', '10e3ddb4-3a46-42cc-b4da-862688a1152a'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:27:23 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Delete snapshot completed successfully. Aug 13 09:27:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-9f5fe08b-244a-4410-aeb4-c0cc41c6abc4-delete_snapshot" released by "delete_snapshot" :: held 2.564s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Snapshots deleted, issuing volume delete {{(pid=94670) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 13 09:27:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-quobyte-e24e397d-1ad9-4cdd-80ab-707f62d6f568" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-e24e397d-1ad9-4cdd-80ab-707f62d6f568" acquired by "delete_volume" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:23 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e79c582-b37a-4822-8642-499afce803f4]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:23 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 Aug 13 09:27:23 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:24 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568" returned: 0 in 0.721s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:24 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568 Aug 13 09:27:24 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:24 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e24e397d-1ad9-4cdd-80ab-707f62d6f568" returned: 0 in 0.390s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-e24e397d-1ad9-4cdd-80ab-707f62d6f568" released by "delete_volume" :: held 1.236s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:24 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Created reservations ['140d1180-7cdc-4b79-a987-a7e3f43e97b7', 'e4f3a973-5760-442c-add8-d3f0dd27f8ab', '824d9e1f-8ce9-4a16-8efb-0666cc434f74', '961d6327-af7e-44b4-9dc4-7e377e463dc8'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:27:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:25 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:27:25 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:25 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.477s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:25 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:27:25 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Deleted volume successfully. Aug 13 09:27:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1836df7e-d7e0-4498-888a-9d886e43a02c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-e24e397d-1ad9-4cdd-80ab-707f62d6f568-delete_volume" released by "delete_volume" :: held 9.007s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Flow 'volume_create_manager' (24cae19f-1556-4d95-9c97-5fb0e70519a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324729c8-976f-4615-905b-08347adf0699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324729c8-976f-4615-905b-08347adf0699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-975860118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69931df7-8cb7-4acd-9e96-46e1abac65cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2716280c1a67425f8def884d84a78d7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:26Z,use_quota=True,user_id='468302b124284cebb2bdc8e108b2b9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b016f8d2-e487-43bb-a26a-89b3d4bc415d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b016f8d2-e487-43bb-a26a-89b3d4bc415d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e36c301-a9a4-4911-b346-7c929042eb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e36c301-a9a4-4911-b346-7c929042eb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69931df7-8cb7-4acd-9e96-46e1abac65cd', 'volume_name': 'volume-69931df7-8cb7-4acd-9e96-46e1abac65cd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7950c3d7-5f61-4d50-9819-943445c4ebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7950c3d7-5f61-4d50-9819-943445c4ebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375a0ebc-73fb-498e-a495-2ce4007fe36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:26 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Volume 69931df7-8cb7-4acd-9e96-46e1abac65cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69931df7-8cb7-4acd-9e96-46e1abac65cd', 'volume_size': 1} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-975860118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69931df7-8cb7-4acd-9e96-46e1abac65cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2716280c1a67425f8def884d84a78d7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:26Z,use_quota=True,user_id='468302b124284cebb2bdc8e108b2b9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Creating volume 69931df7-8cb7-4acd-9e96-46e1abac65cd {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:27:26 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:27:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:26 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd 1073741824 Aug 13 09:27:26 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:27 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd 1073741824" returned: 0 in 0.614s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:27 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd Aug 13 09:27:27 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:27 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd" returned: 0 in 0.448s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375a0ebc-73fb-498e-a495-2ce4007fe36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69931df7-8cb7-4acd-9e96-46e1abac65cd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9e6ade-3b6f-460c-82a4-e021c624a48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:27 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Volume volume-69931df7-8cb7-4acd-9e96-46e1abac65cd (69931df7-8cb7-4acd-9e96-46e1abac65cd): created successfully Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9e6ade-3b6f-460c-82a4-e021c624a48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Flow 'volume_create_manager' (24cae19f-1556-4d95-9c97-5fb0e70519a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:27 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-01ef026d-29e9-46d1-aa4d-781a14ee8234 tempest-VolumesDeleteCascade-1263478308 None] Created volume successfully. Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Flow 'volume_create_manager' (faa55f23-614e-4eef-863c-9d7d058da6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cfc852-0a5d-4080-8e18-65f59a3666ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cfc852-0a5d-4080-8e18-65f59a3666ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-905225057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3e1554-b6b8-4798-87c0-aff6e9bbde23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26482a99f2c54e4d9e239de8aeb79fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:28Z,use_quota=True,user_id='151166b6a8fc40fbb58a8b7479133f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd09bbf9-40b7-499e-97c9-9a884091d6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd09bbf9-40b7-499e-97c9-9a884091d6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2ef823-4591-4411-932b-1b02fdc7ee9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2ef823-4591-4411-932b-1b02fdc7ee9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3e1554-b6b8-4798-87c0-aff6e9bbde23', 'volume_name': 'volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9040e8ce-cdc0-44e9-9e30-84e4e8367aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9040e8ce-cdc0-44e9-9e30-84e4e8367aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff35b5b-ca3b-4fa6-8fb6-1bfbf40ae7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:27 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Volume 0d3e1554-b6b8-4798-87c0-aff6e9bbde23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23', 'volume_size': 1} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-905225057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3e1554-b6b8-4798-87c0-aff6e9bbde23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26482a99f2c54e4d9e239de8aeb79fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:28Z,use_quota=True,user_id='151166b6a8fc40fbb58a8b7479133f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Creating volume 0d3e1554-b6b8-4798-87c0-aff6e9bbde23 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:27:27 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:27:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:27 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 1073741824 Aug 13 09:27:27 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:28 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 1073741824" returned: 0 in 0.538s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:28 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 Aug 13 09:27:28 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:28 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23" returned: 0 in 0.353s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:27:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.026s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff35b5b-ca3b-4fa6-8fb6-1bfbf40ae7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728b3962-fad9-49d7-810f-e33ae75964b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] Creating offline snapshot ba681b82-4cc3-4d57-af45-208ee7674aad of volume 69931df7-8cb7-4acd-9e96-46e1abac65cd {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:27:28 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Volume volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 (0d3e1554-b6b8-4798-87c0-aff6e9bbde23): created successfully Aug 13 09:27:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728b3962-fad9-49d7-810f-e33ae75964b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Flow 'volume_create_manager' (faa55f23-614e-4eef-863c-9d7d058da6ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:28 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23239ae-1050-4ca7-bfc5-6083d79e8c42]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:28 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e6387553-46d6-474e-8b57-e2f43f13bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Created volume successfully. Aug 13 09:27:29 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd Aug 13 09:27:29 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:29 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd" returned: 0 in 0.444s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:29 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad 1G Aug 13 09:27:29 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:29 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad 1G" returned: 0 in 0.523s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69931df7-8cb7-4acd-9e96-46e1abac65cd -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:29 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69931df7-8cb7-4acd-9e96-46e1abac65cd -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad Aug 13 09:27:29 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:30 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69931df7-8cb7-4acd-9e96-46e1abac65cd -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad" returned: 0 in 0.426s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:30 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad is being set with open permissions: ugo+rw Aug 13 09:27:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:30 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad Aug 13 09:27:30 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:30 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad" returned: 0 in 0.301s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:30 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.info Aug 13 09:27:30 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:30 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.info" returned: 0 in 0.338s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:31 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.info is being set with open permissions: ugo+rw Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:27:31 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.info Aug 13 09:27:31 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Flow 'volume_create_manager' (0689c5e6-0ede-4299-afd6-afcad88e413a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc03ed6-537d-4b89-b170-2cab386141a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc03ed6-537d-4b89-b170-2cab386141a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-807359850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad48226-7ac9-46da-8896-f391e390f467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f926a1bbd23848548aa0dcc6fb63c2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:31Z,use_quota=True,user_id='e3c3987e054049cfac72d30390fdc9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a255e265-d76e-4713-939e-e38728e78884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a255e265-d76e-4713-939e-e38728e78884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca2eeb5-75bb-4eab-8900-e1ab186869c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca2eeb5-75bb-4eab-8900-e1ab186869c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad48226-7ac9-46da-8896-f391e390f467', 'volume_name': 'volume-9ad48226-7ac9-46da-8896-f391e390f467', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7f8114-e9b5-49ad-bf4e-acf884f75510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7f8114-e9b5-49ad-bf4e-acf884f75510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92a4ea5-060b-424d-94fc-e466a8341b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:31 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Volume 9ad48226-7ac9-46da-8896-f391e390f467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad48226-7ac9-46da-8896-f391e390f467', 'volume_size': 1} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:31 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.info" returned: 0 in 0.323s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.509s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.207s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Creating offline snapshot e13214e3-fc54-4fa3-8fb3-0e6795dbdaad of volume 0d3e1554-b6b8-4798-87c0-aff6e9bbde23 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:27:31 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-ae300b24-0bef-4019-837b-6469be24ff24 tempest-VolumesDeleteCascade-1263478308 None] Create snapshot completed successfully Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2344c064-0173-4aa3-8b4c-d73f8c9c6e48]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:31 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 Aug 13 09:27:31 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:31 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23" returned: 0 in 0.437s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:31 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad 1G Aug 13 09:27:31 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:32 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad 1G" returned: 0 in 0.587s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:32 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad Aug 13 09:27:32 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Flow 'volume_create_manager' (3e3bd70f-685b-4b0f-b58d-9c128fefdfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f6a8cc-1c18-4d76-8316-d2c72e4bfb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:32 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f6a8cc-1c18-4d76-8316-d2c72e4bfb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2033810567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbe0456-da6d-4ce6-b4f2-a07bb0453377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2716280c1a67425f8def884d84a78d7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ba681b82-4cc3-4d57-af45-208ee7674aad,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:33Z,use_quota=True,user_id='468302b124284cebb2bdc8e108b2b9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5422251-384e-426c-8742-c9acb602ac47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5422251-384e-426c-8742-c9acb602ac47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac4795e-70b4-4be2-8f7e-b42ea2ef8e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac4795e-70b4-4be2-8f7e-b42ea2ef8e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7fbe0456-da6d-4ce6-b4f2-a07bb0453377', 'volume_name': 'volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377', 'volume_size': 1, 'snapshot_id': 'ba681b82-4cc3-4d57-af45-208ee7674aad'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f438c14-e951-4c1f-a654-22cfaaa549f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f438c14-e951-4c1f-a654-22cfaaa549f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58013559-49aa-43d6-9c18-7d7bcc42d59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:32 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Volume 7fbe0456-da6d-4ce6-b4f2-a07bb0453377: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377', 'volume_size': 1, 'snapshot_id': 'ba681b82-4cc3-4d57-af45-208ee7674aad'} Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad" returned: 0 in 0.415s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:32 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad is being set with open permissions: ugo+rw Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:32 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad Aug 13 09:27:32 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:33 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad" returned: 0 in 0.285s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:33 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.info Aug 13 09:27:33 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:33 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.info" returned: 0 in 0.267s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:33 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.info is being set with open permissions: ugo+rw Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:33 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.info Aug 13 09:27:33 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:33 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.info" returned: 0 in 0.276s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.396s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.632s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-807359850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad48226-7ac9-46da-8896-f391e390f467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f926a1bbd23848548aa0dcc6fb63c2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:31Z,use_quota=True,user_id='e3c3987e054049cfac72d30390fdc9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Creating volume 9ad48226-7ac9-46da-8896-f391e390f467 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:27:33 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:27:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ad48226-7ac9-46da-8896-f391e390f467 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:33 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ad48226-7ac9-46da-8896-f391e390f467 1073741824 Aug 13 09:27:33 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:33 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-afb22631-162c-4f3d-9241-760d9c9c092b tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Create snapshot completed successfully Aug 13 09:27:34 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ad48226-7ac9-46da-8896-f391e390f467 1073741824" returned: 0 in 0.768s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ad48226-7ac9-46da-8896-f391e390f467 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:34 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ad48226-7ac9-46da-8896-f391e390f467 Aug 13 09:27:34 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:35 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ad48226-7ac9-46da-8896-f391e390f467" returned: 0 in 0.294s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.278s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-quobyte-ba681b82-4cc3-4d57-af45-208ee7674aad-7fbe0456-da6d-4ce6-b4f2-a07bb0453377" by "_create_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92a4ea5-060b-424d-94fc-e466a8341b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad48226-7ac9-46da-8896-f391e390f467', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b3c73f-28d3-4fac-ba67-8fe4847b8fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-ba681b82-4cc3-4d57-af45-208ee7674aad-7fbe0456-da6d-4ce6-b4f2-a07bb0453377" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Creating volume 7fbe0456-da6d-4ce6-b4f2-a07bb0453377 from snapshot ba681b82-4cc3-4d57-af45-208ee7674aad {{(pid=94670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-quobyte-7fbe0456-da6d-4ce6-b4f2-a07bb0453377" by "_copy_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-7fbe0456-da6d-4ce6-b4f2-a07bb0453377" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] snapshot: ba681b82-4cc3-4d57-af45-208ee7674aad, volume: 7fbe0456-da6d-4ce6-b4f2-a07bb0453377, {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f334128-c30d-450b-a6e7-fb2ab8d87ec7]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:35 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Volume volume-9ad48226-7ac9-46da-8896-f391e390f467 (9ad48226-7ac9-46da-8896-f391e390f467): created successfully Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b3c73f-28d3-4fac-ba67-8fe4847b8fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Flow 'volume_create_manager' (0689c5e6-0ede-4299-afd6-afcad88e413a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:35 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad Aug 13 09:27:35 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Acquiring lock "cinder-e13214e3-fc54-4fa3-8fb3-0e6795dbdaad-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "cinder-e13214e3-fc54-4fa3-8fb3-0e6795dbdaad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Acquiring lock "cinder-quobyte-0d3e1554-b6b8-4798-87c0-aff6e9bbde23" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "cinder-quobyte-0d3e1554-b6b8-4798-87c0-aff6e9bbde23" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Acquiring lock "cinder-quobyte-e13214e3-fc54-4fa3-8fb3-0e6795dbdaad" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:35 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-956492f0-7750-4e32-b004-1c66bd1e129b tempest-VolumesServicesTestJSON-169523502 None] Created volume successfully. Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "cinder-quobyte-e13214e3-fc54-4fa3-8fb3-0e6795dbdaad" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Deleting offline snapshot e13214e3-fc54-4fa3-8fb3-0e6795dbdaad of volume 0d3e1554-b6b8-4798-87c0-aff6e9bbde23 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] snapshot_file for this snap is: volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daf8aad-467f-4c93-851e-49332f292635]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:35 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad Aug 13 09:27:35 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:35 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad" returned: 0 in 0.569s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69931df7-8cb7-4acd-9e96-46e1abac65cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Creating direct copy from snapshot {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a39a8c1-a9f2-41f2-9968-6ce44a1dd0c5]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:36 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd Aug 13 09:27:36 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:36 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad" returned: 0 in 0.400s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:27:36 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[193eb9d1-25ca-44d0-86f4-cdbc7807862c]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:36 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 Aug 13 09:27:36 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:36 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd" returned: 0 in 0.477s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:36 devstack cinder-volume[94670]: DEBUG cinder.utils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Path /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377 not found in is_blk_device check {{(pid=94670) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 13 09:27:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:36 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377 Aug 13 09:27:36 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Acquiring lock "cinder-9ad48226-7ac9-46da-8896-f391e390f467-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Lock "cinder-9ad48226-7ac9-46da-8896-f391e390f467-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:36 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23" returned: 0 in 0.577s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:36 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad Aug 13 09:27:36 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Acquiring lock "cinder-quobyte-9ad48226-7ac9-46da-8896-f391e390f467" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Lock "cinder-quobyte-9ad48226-7ac9-46da-8896-f391e390f467" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:36 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b08cee1-f280-47c7-b841-0b17aac01a2f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ad48226-7ac9-46da-8896-f391e390f467 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:37 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ad48226-7ac9-46da-8896-f391e390f467 Aug 13 09:27:37 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:37 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad" returned: 0 in 0.867s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:37 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad Aug 13 09:27:37 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:37 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ad48226-7ac9-46da-8896-f391e390f467" returned: 0 in 0.956s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ad48226-7ac9-46da-8896-f391e390f467 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:37 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ad48226-7ac9-46da-8896-f391e390f467 Aug 13 09:27:37 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:38 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23.e13214e3-fc54-4fa3-8fb3-0e6795dbdaad" returned: 0 in 1.008s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:38 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ad48226-7ac9-46da-8896-f391e390f467" returned: 0 in 0.862s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "cinder-quobyte-e13214e3-fc54-4fa3-8fb3-0e6795dbdaad" released by "_delete_snapshot" :: held 3.143s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Lock "cinder-quobyte-9ad48226-7ac9-46da-8896-f391e390f467" released by "delete_volume" :: held 1.900s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "cinder-quobyte-0d3e1554-b6b8-4798-87c0-aff6e9bbde23" released by "delete_snapshot" :: held 3.197s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:39 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Created reservations ['63f07257-49f5-4444-8339-e55f1483b7ec', '5e908b48-2f34-41d1-b88b-2b1cc18b2920', '4d99c115-e14f-4e9b-af72-0298b35a6105', '32becd75-30c6-4c12-a0fd-0e898f349059'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:27:39 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Created reservations ['6da5e604-da75-411a-bc4c-6d05c7683cfa', '549e3dcc-4c45-48fb-bbb5-24e917f17eff', 'e22673eb-db2c-438e-a966-54195f85364b', '94d0845a-0529-4c02-8abc-bd3fe9106c34'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:27:39 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Delete snapshot completed successfully. Aug 13 09:27:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b20389ff-02c0-4968-b268-7de235b80dc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "cinder-e13214e3-fc54-4fa3-8fb3-0e6795dbdaad-delete_snapshot" released by "delete_snapshot" :: held 3.911s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:39 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:27:39 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:40 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.621s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:40 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:27:40 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Deleted volume successfully. Aug 13 09:27:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Acquiring lock "cinder-0d3e1554-b6b8-4798-87c0-aff6e9bbde23-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "cinder-0d3e1554-b6b8-4798-87c0-aff6e9bbde23-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-313d61fa-ea4c-4472-b02c-87c0b050d937 tempest-VolumesServicesTestJSON-169523502 None] Lock "cinder-9ad48226-7ac9-46da-8896-f391e390f467-delete_volume" released by "delete_volume" :: held 3.895s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Acquiring lock "cinder-quobyte-0d3e1554-b6b8-4798-87c0-aff6e9bbde23" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "cinder-quobyte-0d3e1554-b6b8-4798-87c0-aff6e9bbde23" acquired by "delete_volume" :: waited 0.072s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:40 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e47685-7db4-4958-aacd-969d70596a15]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:41 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 Aug 13 09:27:41 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:42 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23" returned: 0 in 1.457s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:42 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23 Aug 13 09:27:42 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:27:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:43 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:27:43 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:43 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0d3e1554-b6b8-4798-87c0-aff6e9bbde23" returned: 0 in 1.424s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "cinder-quobyte-0d3e1554-b6b8-4798-87c0-aff6e9bbde23" released by "delete_volume" :: held 3.199s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:44 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Created reservations ['8b413127-5e41-4154-b00e-86889f68e100', '1fdd2f2d-b8eb-4117-b761-d0dc1ebafc8f', 'c62b781f-6501-4e6a-93c7-12fc892b6b1c', 'cf82570b-baa5-489c-89a0-2104217d3397'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:27:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:44 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:27:44 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:44 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 1.670s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:44 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:27:44 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:27:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:27:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:27:45 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377" returned: 0 in 9.269s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:45 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[87df7569-f6d5-409c-8f5b-00c3f24d8d05]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:45 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 1.097s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:45 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:27:45 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Deleted volume successfully. Aug 13 09:27:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4751b11b-bce9-4f33-bc27-d38d68f84ea7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580723070 None] Lock "cinder-0d3e1554-b6b8-4798-87c0-aff6e9bbde23-delete_volume" released by "delete_volume" :: held 5.367s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:45 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd Aug 13 09:27:45 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:46 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd" returned: 0 in 0.944s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:46 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Image conversion details: src /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd, size 1024.00 MB, duration 9.27 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377 {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:27:46 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Converted 1024.00 MB image at 110.46 MB/s Aug 13 09:27:46 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377 is being set with open permissions: ugo+rw Aug 13 09:27:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:46 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377 Aug 13 09:27:46 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:46 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377" returned: 0 in 0.333s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-7fbe0456-da6d-4ce6-b4f2-a07bb0453377" released by "_copy_volume_from_snapshot" :: held 11.771s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-ba681b82-4cc3-4d57-af45-208ee7674aad-7fbe0456-da6d-4ce6-b4f2-a07bb0453377" released by "_create_volume_from_snapshot" :: held 11.831s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.871s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58013559-49aa-43d6-9c18-7d7bcc42d59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377', 'volume_size': 1, 'snapshot_id': 'ba681b82-4cc3-4d57-af45-208ee7674aad'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46cd45e-8783-4dc5-92bf-9ca31ffc3680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:47 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Volume volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377 (7fbe0456-da6d-4ce6-b4f2-a07bb0453377): created successfully Aug 13 09:27:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46cd45e-8783-4dc5-92bf-9ca31ffc3680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Flow 'volume_create_manager' (3e3bd70f-685b-4b0f-b58d-9c128fefdfba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:47 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5f59ebdf-d738-48bf-97ab-f8b41cabbf02 tempest-VolumesDeleteCascade-1263478308 None] Created volume successfully. Aug 13 09:27:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-69931df7-8cb7-4acd-9e96-46e1abac65cd-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-69931df7-8cb7-4acd-9e96-46e1abac65cd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Performing cascade delete. {{(pid=94670) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 13 09:27:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-ba681b82-4cc3-4d57-af45-208ee7674aad-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-ba681b82-4cc3-4d57-af45-208ee7674aad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-quobyte-69931df7-8cb7-4acd-9e96-46e1abac65cd" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-69931df7-8cb7-4acd-9e96-46e1abac65cd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-quobyte-ba681b82-4cc3-4d57-af45-208ee7674aad" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-ba681b82-4cc3-4d57-af45-208ee7674aad" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Deleting offline snapshot ba681b82-4cc3-4d57-af45-208ee7674aad of volume 69931df7-8cb7-4acd-9e96-46e1abac65cd {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:27:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] snapshot_file for this snap is: volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:27:48 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[510c6878-9ac4-4259-ba72-4d4c701c6af1]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:48 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad Aug 13 09:27:48 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:49 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad" returned: 0 in 0.473s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:49 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69931df7-8cb7-4acd-9e96-46e1abac65cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:27:49 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e172df-a4de-4e39-89ad-22d466397fc3]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:49 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd Aug 13 09:27:49 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:49 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd" returned: 0 in 0.483s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:49 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad Aug 13 09:27:49 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:49 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad" returned: 0 in 0.366s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:49 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad Aug 13 09:27:49 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:50 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd.ba681b82-4cc3-4d57-af45-208ee7674aad" returned: 0 in 0.264s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-ba681b82-4cc3-4d57-af45-208ee7674aad" released by "_delete_snapshot" :: held 1.725s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-69931df7-8cb7-4acd-9e96-46e1abac65cd" released by "delete_snapshot" :: held 1.759s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:50 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Created reservations ['7d3bedc8-aceb-4f41-90d3-f7d7cd0edbc4', '3afe58f0-cc0b-46ae-b8b7-43ae8f4d5be4', '032da1d8-6c90-4d7a-95d4-e3b91671776f', '2739399e-6a6c-4d52-aa76-b4bbc0d84c57'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:27:50 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Delete snapshot completed successfully. Aug 13 09:27:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-ba681b82-4cc3-4d57-af45-208ee7674aad-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Snapshots deleted, issuing volume delete {{(pid=94670) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 13 09:27:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-quobyte-69931df7-8cb7-4acd-9e96-46e1abac65cd" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-69931df7-8cb7-4acd-9e96-46e1abac65cd" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:50 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfa5e54-551f-485e-b9a7-2b882b7dd8b7]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:50 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd Aug 13 09:27:50 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:50 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd" returned: 0 in 0.406s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:50 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd Aug 13 09:27:50 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:51 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69931df7-8cb7-4acd-9e96-46e1abac65cd" returned: 0 in 0.286s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:51 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-69931df7-8cb7-4acd-9e96-46e1abac65cd" released by "delete_volume" :: held 0.767s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:51 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Created reservations ['e7faa740-3173-42da-8fef-f6a126f7269d', '7af19fda-278b-4d4a-a3ac-f69ea051adc4', '00a61f3f-2bd7-42fe-9e48-dcefb91719e9', '13b5f35d-6547-475e-b4a1-af4955438a11'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:27:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:51 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:27:51 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:51 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.261s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:51 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:27:51 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Deleted volume successfully. Aug 13 09:27:51 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6adf5777-295d-4c80-a093-6eb921f2db84 tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-69931df7-8cb7-4acd-9e96-46e1abac65cd-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:51 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-7fbe0456-da6d-4ce6-b4f2-a07bb0453377-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:51 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-7fbe0456-da6d-4ce6-b4f2-a07bb0453377-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:52 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "cinder-quobyte-7fbe0456-da6d-4ce6-b4f2-a07bb0453377" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:27:52 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-7fbe0456-da6d-4ce6-b4f2-a07bb0453377" acquired by "delete_volume" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:27:52 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a6586e-89fa-413c-a964-81968475c174]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:27:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:52 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377 Aug 13 09:27:52 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:52 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377" returned: 0 in 0.447s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:52 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377 Aug 13 09:27:52 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:52 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7fbe0456-da6d-4ce6-b4f2-a07bb0453377" returned: 0 in 0.305s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:52 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-quobyte-7fbe0456-da6d-4ce6-b4f2-a07bb0453377" released by "delete_volume" :: held 0.805s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:52 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Created reservations ['ba65238a-629f-42cc-82fa-f069e0e9573e', 'cf19d99d-b70b-464c-b566-cb661d0ec22c', 'e1596b26-5aef-4012-b6fe-861144d835e1', '65982ec3-db7c-4899-a79b-e8fe9558b826'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:27:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:53 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:27:53 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:53 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.370s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:53 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:27:53 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Deleted volume successfully. Aug 13 09:27:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f6b7873b-eda1-4a9d-8856-72f5615b6c9c tempest-VolumesDeleteCascade-1263478308 None] Lock "cinder-7fbe0456-da6d-4ce6-b4f2-a07bb0453377-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Flow 'volume_create_manager' (d323425e-d01b-4c3b-b804-60e577d88178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f79583-9a6e-4b3d-896b-c8141c6cb70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f79583-9a6e-4b3d-896b-c8141c6cb70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1908192149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb5f35b-92b0-4218-9f74-bb4c16582b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66dfbd73ab545f0961838bdb359960c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:59Z,use_quota=True,user_id='c89ea8451920423bbcdf987dd62323aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834071f9-962a-4ca8-86e7-dccb5ac0d175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834071f9-962a-4ca8-86e7-dccb5ac0d175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe21489-6e46-4819-ada2-b686ca0fda86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe21489-6e46-4819-ada2-b686ca0fda86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb5f35b-92b0-4218-9f74-bb4c16582b05', 'volume_name': 'volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5415f6-0b7a-4710-a3d7-3354cedd61e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5415f6-0b7a-4710-a3d7-3354cedd61e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5987e7b1-5993-4a7a-9885-cf4ac0755f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:59 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Volume 0cb5f35b-92b0-4218-9f74-bb4c16582b05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05', 'volume_size': 1} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1908192149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb5f35b-92b0-4218-9f74-bb4c16582b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66dfbd73ab545f0961838bdb359960c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:59Z,use_quota=True,user_id='c89ea8451920423bbcdf987dd62323aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Creating volume 0cb5f35b-92b0-4218-9f74-bb4c16582b05 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:27:59 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:59 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05 1073741824 Aug 13 09:27:59 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Flow 'volume_create_manager' (722ab7e4-d869-4d99-8a1a-e265a377b911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2364b8c-f310-4ca6-916d-f676625e02b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2364b8c-f310-4ca6-916d-f676625e02b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1736771494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f043517-a455-4c83-af26-9bfaa65f27f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5050730705c245ea8d8cd064dfaeb2dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:59Z,use_quota=True,user_id='ac3baa83d1754ee6bfa1827e50d0233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b44818e3-3a1e-40c0-bc65-0cc9203b1f8a),volume_type_id=b44818e3-3a1e-40c0-bc65-0cc9203b1f8a)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8b83f4-0edc-46ff-bd21-a790ef955ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8b83f4-0edc-46ff-bd21-a790ef955ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a04bd24-d06f-41d5-826f-d229f33e5012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a04bd24-d06f-41d5-826f-d229f33e5012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f043517-a455-4c83-af26-9bfaa65f27f5', 'volume_name': 'volume-9f043517-a455-4c83-af26-9bfaa65f27f5', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49daa42f-4f6c-4667-a807-1889892fb065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49daa42f-4f6c-4667-a807-1889892fb065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597c8a85-947a-4961-9ec5-b74b0b25f68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:59 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Volume 9f043517-a455-4c83-af26-9bfaa65f27f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f043517-a455-4c83-af26-9bfaa65f27f5', 'volume_size': 1} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:59 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05 1073741824" returned: 0 in 0.481s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Flow 'volume_create_manager' (079d928b-d6bf-4b9b-81a6-372547f02146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58c5660-9575-4e6a-894b-e737f28814ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58c5660-9575-4e6a-894b-e737f28814ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-939873612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b1acca-e399-4cf9-84f2-fc35833a564f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a53b103dd394f518b718fba15d0da5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:00Z,use_quota=True,user_id='fc1bc56232244ae9a4fc261836a42a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eab531b-9c12-463e-8815-afa8003d5a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eab531b-9c12-463e-8815-afa8003d5a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936b1bec-42db-4484-bf5a-4b18511506d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936b1bec-42db-4484-bf5a-4b18511506d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14b1acca-e399-4cf9-84f2-fc35833a564f', 'volume_name': 'volume-14b1acca-e399-4cf9-84f2-fc35833a564f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2795413d-e816-4525-85b1-a48dd83a29d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2795413d-e816-4525-85b1-a48dd83a29d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7fffa2-500a-4b46-8bd3-de00798c7d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:27:59 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Volume 14b1acca-e399-4cf9-84f2-fc35833a564f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14b1acca-e399-4cf9-84f2-fc35833a564f', 'volume_size': 1} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:27:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:27:59 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05 Aug 13 09:27:59 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:00 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05" returned: 0 in 0.239s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.542s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1736771494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f043517-a455-4c83-af26-9bfaa65f27f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5050730705c245ea8d8cd064dfaeb2dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:27:59Z,use_quota=True,user_id='ac3baa83d1754ee6bfa1827e50d0233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b44818e3-3a1e-40c0-bc65-0cc9203b1f8a),volume_type_id=b44818e3-3a1e-40c0-bc65-0cc9203b1f8a)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Creating volume 9f043517-a455-4c83-af26-9bfaa65f27f5 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:28:00 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f043517-a455-4c83-af26-9bfaa65f27f5 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5987e7b1-5993-4a7a-9885-cf4ac0755f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cb12e4-2022-4bee-b5f8-51a209384259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:00 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f043517-a455-4c83-af26-9bfaa65f27f5 1073741824 Aug 13 09:28:00 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:00 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Volume volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05 (0cb5f35b-92b0-4218-9f74-bb4c16582b05): created successfully Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cb12e4-2022-4bee-b5f8-51a209384259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Flow 'volume_create_manager' (d323425e-d01b-4c3b-b804-60e577d88178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:00 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-729dd6a8-2d17-4790-96b9-f48cf1a874b8 tempest-VolumesTransfersV355Test-2043268559 None] Created volume successfully. Aug 13 09:28:00 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f043517-a455-4c83-af26-9bfaa65f27f5 1073741824" returned: 0 in 0.478s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f043517-a455-4c83-af26-9bfaa65f27f5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:00 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f043517-a455-4c83-af26-9bfaa65f27f5 Aug 13 09:28:00 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:00 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f043517-a455-4c83-af26-9bfaa65f27f5" returned: 0 in 0.258s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.037s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-939873612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b1acca-e399-4cf9-84f2-fc35833a564f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a53b103dd394f518b718fba15d0da5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:00Z,use_quota=True,user_id='fc1bc56232244ae9a4fc261836a42a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Creating volume 14b1acca-e399-4cf9-84f2-fc35833a564f {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:28:00 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-14b1acca-e399-4cf9-84f2-fc35833a564f 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597c8a85-947a-4961-9ec5-b74b0b25f68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f043517-a455-4c83-af26-9bfaa65f27f5', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:00 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-14b1acca-e399-4cf9-84f2-fc35833a564f 1073741824 Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2633f0e-7eca-4163-a024-2d5f051944c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:00 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:00 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Volume volume-9f043517-a455-4c83-af26-9bfaa65f27f5 (9f043517-a455-4c83-af26-9bfaa65f27f5): created successfully Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2633f0e-7eca-4163-a024-2d5f051944c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Flow 'volume_create_manager' (722ab7e4-d869-4d99-8a1a-e265a377b911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:00 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-478250cc-88f8-4394-9df4-051c97573b51 tempest-VolumeTypesAccessTest-685594076 None] Created volume successfully. Aug 13 09:28:01 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-976845bb-de67-41f4-9d3e-3cbf38feb778 tempest-VolumesTransfersV355Test-535010979 None] Transfer volume completed successfully. Aug 13 09:28:01 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-14b1acca-e399-4cf9-84f2-fc35833a564f 1073741824" returned: 0 in 0.533s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-14b1acca-e399-4cf9-84f2-fc35833a564f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:01 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-14b1acca-e399-4cf9-84f2-fc35833a564f Aug 13 09:28:01 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Acquiring lock "cinder-9f043517-a455-4c83-af26-9bfaa65f27f5-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Acquiring lock "cinder-0cb5f35b-92b0-4218-9f74-bb4c16582b05-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Lock "cinder-9f043517-a455-4c83-af26-9bfaa65f27f5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Lock "cinder-0cb5f35b-92b0-4218-9f74-bb4c16582b05-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Acquiring lock "cinder-quobyte-9f043517-a455-4c83-af26-9bfaa65f27f5" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Acquiring lock "cinder-quobyte-0cb5f35b-92b0-4218-9f74-bb4c16582b05" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Lock "cinder-quobyte-9f043517-a455-4c83-af26-9bfaa65f27f5" acquired by "delete_volume" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Lock "cinder-quobyte-0cb5f35b-92b0-4218-9f74-bb4c16582b05" acquired by "delete_volume" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[968537e5-642d-4024-bc1b-7c26bf5fa0e2]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f043517-a455-4c83-af26-9bfaa65f27f5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[26803b59-7250-445a-be72-d22e7f02c65e]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:01 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-14b1acca-e399-4cf9-84f2-fc35833a564f" returned: 0 in 0.311s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:01 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f043517-a455-4c83-af26-9bfaa65f27f5 Aug 13 09:28:01 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7fffa2-500a-4b46-8bd3-de00798c7d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14b1acca-e399-4cf9-84f2-fc35833a564f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602c231a-dac6-4124-84d6-83db96173a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:01 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05 Aug 13 09:28:01 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:01 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Volume volume-14b1acca-e399-4cf9-84f2-fc35833a564f (14b1acca-e399-4cf9-84f2-fc35833a564f): created successfully Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602c231a-dac6-4124-84d6-83db96173a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Flow 'volume_create_manager' (079d928b-d6bf-4b9b-81a6-372547f02146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:01 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-31e6a8e9-0bad-46b2-aac1-f97de43b77ab tempest-AbsoluteLimitsTests-997184012 None] Created volume successfully. Aug 13 09:28:02 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f043517-a455-4c83-af26-9bfaa65f27f5" returned: 0 in 0.389s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f043517-a455-4c83-af26-9bfaa65f27f5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:02 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05" returned: 0 in 0.385s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:02 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f043517-a455-4c83-af26-9bfaa65f27f5 Aug 13 09:28:02 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:02 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05 Aug 13 09:28:02 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:02 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f043517-a455-4c83-af26-9bfaa65f27f5" returned: 0 in 0.244s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Lock "cinder-quobyte-9f043517-a455-4c83-af26-9bfaa65f27f5" released by "delete_volume" :: held 0.687s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:02 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0cb5f35b-92b0-4218-9f74-bb4c16582b05" returned: 0 in 0.251s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Lock "cinder-quobyte-0cb5f35b-92b0-4218-9f74-bb4c16582b05" released by "delete_volume" :: held 0.687s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:02 devstack cinder-volume[94670]: WARNING cinder.quota [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2019845508 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2019845508, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:28:02 devstack cinder-volume[94670]: WARNING cinder.quota [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2019845508 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2019845508, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Created reservations ['dcd3d38e-726b-4235-b450-802e2448b0d5', '28313dcf-feaf-4666-b6e4-61fd375ed617', 'cfd9a1c4-53c5-44dd-9159-f5ad600f843a', '7d81a287-5a1c-44e1-b727-eef3f1a55a22'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Created reservations ['4bc7a42e-c5c9-42dc-b191-b2fd9e3903cc', 'e5b2f4ae-0453-4e57-ae1e-6fd0ea73ff14', '2a0da74f-8af6-4a3e-91f1-3ac1d751faa4', 'af42f36b-b366-4b05-9f11-48cc4c24dd2d'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:02 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:02 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:02 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:02 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:02 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.291s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:02 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Deleted volume successfully. Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c32d3c9b-6e1f-40bd-9193-5e6152c140f6 tempest-VolumeTypesAccessTest-685594076 None] Lock "cinder-9f043517-a455-4c83-af26-9bfaa65f27f5-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:02 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.304s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:02 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Deleted volume successfully. Aug 13 09:28:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-05707f5a-eae6-44a4-a230-06d6af735e50 tempest-VolumesTransfersV355Test-564445165 None] Lock "cinder-0cb5f35b-92b0-4218-9f74-bb4c16582b05-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Acquiring lock "cinder-14b1acca-e399-4cf9-84f2-fc35833a564f-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Lock "cinder-14b1acca-e399-4cf9-84f2-fc35833a564f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Acquiring lock "cinder-quobyte-14b1acca-e399-4cf9-84f2-fc35833a564f" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Lock "cinder-quobyte-14b1acca-e399-4cf9-84f2-fc35833a564f" acquired by "delete_volume" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab01982d-bf4a-4cb3-b8a0-971fdbf996a6]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-14b1acca-e399-4cf9-84f2-fc35833a564f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:03 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-14b1acca-e399-4cf9-84f2-fc35833a564f Aug 13 09:28:03 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Flow 'volume_create_manager' (13c4f878-d813-4bde-83aa-9c8dde5e50cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209d3a67-fc44-4084-add2-a11433a65e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209d3a67-fc44-4084-add2-a11433a65e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-177942557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f545e2-3b66-4aa4-941f-e4110c567154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66dfbd73ab545f0961838bdb359960c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:03Z,use_quota=True,user_id='c89ea8451920423bbcdf987dd62323aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd6800c-c247-49d4-9589-4cd40fde7535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd6800c-c247-49d4-9589-4cd40fde7535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f793a3c-bf94-43da-858c-94b9452f01cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f793a3c-bf94-43da-858c-94b9452f01cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f545e2-3b66-4aa4-941f-e4110c567154', 'volume_name': 'volume-e6f545e2-3b66-4aa4-941f-e4110c567154', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae50d1b1-5658-4704-bbe2-3cb98968b61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae50d1b1-5658-4704-bbe2-3cb98968b61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1e2049-a7ed-425d-9a50-a351c91ea154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:03 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Volume e6f545e2-3b66-4aa4-941f-e4110c567154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f545e2-3b66-4aa4-941f-e4110c567154', 'volume_size': 1} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-177942557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f545e2-3b66-4aa4-941f-e4110c567154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66dfbd73ab545f0961838bdb359960c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:03Z,use_quota=True,user_id='c89ea8451920423bbcdf987dd62323aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Creating volume e6f545e2-3b66-4aa4-941f-e4110c567154 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:28:03 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e6f545e2-3b66-4aa4-941f-e4110c567154 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:03 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e6f545e2-3b66-4aa4-941f-e4110c567154 1073741824 Aug 13 09:28:03 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:03 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-14b1acca-e399-4cf9-84f2-fc35833a564f" returned: 0 in 0.422s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-14b1acca-e399-4cf9-84f2-fc35833a564f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:03 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-14b1acca-e399-4cf9-84f2-fc35833a564f Aug 13 09:28:03 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:03 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-14b1acca-e399-4cf9-84f2-fc35833a564f" returned: 0 in 0.296s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:04 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Lock "cinder-quobyte-14b1acca-e399-4cf9-84f2-fc35833a564f" released by "delete_volume" :: held 0.778s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e6f545e2-3b66-4aa4-941f-e4110c567154 1073741824" returned: 0 in 0.499s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Created reservations ['9ff6c428-b185-489b-9f38-7c461882a596', '7f1a6732-99aa-428a-953f-c9f3b3997d2f', '3af3e509-9474-4d36-b1a6-25f771097960', '5cf4001a-bf28-40f6-9a9e-0416c8f79144'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e6f545e2-3b66-4aa4-941f-e4110c567154 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:04 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e6f545e2-3b66-4aa4-941f-e4110c567154 Aug 13 09:28:04 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:04 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e6f545e2-3b66-4aa4-941f-e4110c567154" returned: 0 in 0.260s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1e2049-a7ed-425d-9a50-a351c91ea154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f545e2-3b66-4aa4-941f-e4110c567154', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834b4b35-a554-45e1-9c7e-263448d245cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:04 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:04 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:05 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.246s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:05 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:05 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Deleted volume successfully. Aug 13 09:28:05 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Volume volume-e6f545e2-3b66-4aa4-941f-e4110c567154 (e6f545e2-3b66-4aa4-941f-e4110c567154): created successfully Aug 13 09:28:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834b4b35-a554-45e1-9c7e-263448d245cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Flow 'volume_create_manager' (13c4f878-d813-4bde-83aa-9c8dde5e50cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-efe22006-08af-463b-8b67-ee49b171a1e0 tempest-AbsoluteLimitsTests-997184012 None] Lock "cinder-14b1acca-e399-4cf9-84f2-fc35833a564f-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:05 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-2a88c09b-0f93-42c8-b7b2-5af8e559784c tempest-VolumesTransfersV355Test-2043268559 None] Created volume successfully. Aug 13 09:28:06 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Flow 'volume_create_manager' (44ca6add-24f8-48ce-9629-72567e64896c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cf8956-29ae-4ae9-a8d3-935fdc5351bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cf8956-29ae-4ae9-a8d3-935fdc5351bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1382306898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf478dd1-159e-4af1-85a0-3a1970b88d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609e6cdd90c646629787b2d9af1255a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:07Z,use_quota=True,user_id='705ee37b81d14d74a68356876336b8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2e362c-fdde-4b05-b372-2ad0c82ec306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2e362c-fdde-4b05-b372-2ad0c82ec306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716f6c0e-699f-41a1-9104-3253df54922d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716f6c0e-699f-41a1-9104-3253df54922d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf478dd1-159e-4af1-85a0-3a1970b88d0f', 'volume_name': 'volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30be8924-8fd5-4e3b-a6c6-2aee1389b6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30be8924-8fd5-4e3b-a6c6-2aee1389b6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fcc511d-485b-45e3-8de0-9bf52403aca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:07 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Volume bf478dd1-159e-4af1-85a0-3a1970b88d0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f', 'volume_size': 1} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1382306898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf478dd1-159e-4af1-85a0-3a1970b88d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609e6cdd90c646629787b2d9af1255a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:07Z,use_quota=True,user_id='705ee37b81d14d74a68356876336b8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Creating volume bf478dd1-159e-4af1-85a0-3a1970b88d0f {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:28:07 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:07 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f 1073741824 Aug 13 09:28:07 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Acquiring lock "cinder-e6f545e2-3b66-4aa4-941f-e4110c567154-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Lock "cinder-e6f545e2-3b66-4aa4-941f-e4110c567154-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:07 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f 1073741824" returned: 0 in 0.469s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Acquiring lock "cinder-quobyte-e6f545e2-3b66-4aa4-941f-e4110c567154" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Lock "cinder-quobyte-e6f545e2-3b66-4aa4-941f-e4110c567154" acquired by "delete_volume" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d7da58-b044-4cf4-902e-0c5edeae90c0]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e6f545e2-3b66-4aa4-941f-e4110c567154 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:07 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e6f545e2-3b66-4aa4-941f-e4110c567154 Aug 13 09:28:07 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:07 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f Aug 13 09:28:07 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:08 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e6f545e2-3b66-4aa4-941f-e4110c567154" returned: 0 in 0.378s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e6f545e2-3b66-4aa4-941f-e4110c567154 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:08 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e6f545e2-3b66-4aa4-941f-e4110c567154 Aug 13 09:28:08 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:08 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f" returned: 0 in 0.291s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:28:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fcc511d-485b-45e3-8de0-9bf52403aca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72505684-d563-4a1d-afd7-81b39c0cfcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:08 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e6f545e2-3b66-4aa4-941f-e4110c567154" returned: 0 in 0.291s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Lock "cinder-quobyte-e6f545e2-3b66-4aa4-941f-e4110c567154" released by "delete_volume" :: held 0.705s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:08 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Volume volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f (bf478dd1-159e-4af1-85a0-3a1970b88d0f): created successfully Aug 13 09:28:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72505684-d563-4a1d-afd7-81b39c0cfcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Flow 'volume_create_manager' (44ca6add-24f8-48ce-9629-72567e64896c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:08 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-a4a24f13-8ac3-4198-a3a3-8c6c03fcbe9f tempest-AttachVolumeTestJSON-488212827 None] Created volume successfully. Aug 13 09:28:08 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Created reservations ['1bbdbd62-707b-4f0c-8b37-71ffea3a993e', '3d7ae2ed-e137-4559-b043-b5b083e9d073', '2e82cf61-c225-46dd-afba-f2f9d125ffbc', '195cb587-b1f5-4cb1-a397-2d8a606b853a'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:09 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:09 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:09 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:09 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:09 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.269s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:09 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:09 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Deleted volume successfully. Aug 13 09:28:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f62e4c9a-3d32-4582-b7f1-3f1ccb1525cd tempest-VolumesTransfersV355Test-564445165 None] Lock "cinder-e6f545e2-3b66-4aa4-941f-e4110c567154-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-c8270f26-e6fd-4d83-8bda-d482113b943d req-d736ee08-57b6-4848-943b-c448d66858b7 tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-c8270f26-e6fd-4d83-8bda-d482113b943d req-d736ee08-57b6-4848-943b-c448d66858b7 tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:10 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6dac1f-4776-4f37-a44c-1fb20f3c3d0a]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-c8270f26-e6fd-4d83-8bda-d482113b943d req-d736ee08-57b6-4848-943b-c448d66858b7 tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:10 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f Aug 13 09:28:10 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:11 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-c8270f26-e6fd-4d83-8bda-d482113b943d req-d736ee08-57b6-4848-943b-c448d66858b7 tempest-AttachVolumeTestJSON-488212827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f" returned: 0 in 0.472s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-c8270f26-e6fd-4d83-8bda-d482113b943d req-d736ee08-57b6-4848-943b-c448d66858b7 tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.508s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:11 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-c8270f26-e6fd-4d83-8bda-d482113b943d req-d736ee08-57b6-4848-943b-c448d66858b7 tempest-AttachVolumeTestJSON-488212827 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9ff29c2-8af9-4d86-8445-a49a2529ed82', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:28:11 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-c8270f26-e6fd-4d83-8bda-d482113b943d req-d736ee08-57b6-4848-943b-c448d66858b7 tempest-AttachVolumeTestJSON-488212827 None] attachment_update completed successfully. Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=128,cinder:UPDATE=157,cinder:DELETE=13,cinder:INSERT=38 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=116,cinder:UPDATE=149,cinder:DELETE=13,cinder:INSERT=34 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Flow 'volume_create_manager' (0cc92c22-385a-4e12-98f9-d8921e392a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d36825-b164-4afd-b14a-bfc3631cba5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d36825-b164-4afd-b14a-bfc3631cba5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1691659308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9409503-e3e5-45dd-abaf-7c2b5087a503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609e6cdd90c646629787b2d9af1255a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:15Z,use_quota=True,user_id='705ee37b81d14d74a68356876336b8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46758a0c-bd0a-42a9-8cc4-d79b15ab7871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46758a0c-bd0a-42a9-8cc4-d79b15ab7871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53287380-f170-498b-956d-3f478ad3c390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53287380-f170-498b-956d-3f478ad3c390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9409503-e3e5-45dd-abaf-7c2b5087a503', 'volume_name': 'volume-e9409503-e3e5-45dd-abaf-7c2b5087a503', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c318398e-dcc0-4b9a-bf3f-267f9054af80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c318398e-dcc0-4b9a-bf3f-267f9054af80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286a5640-6ac0-42fb-83bc-30194f6a96a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:14 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Volume e9409503-e3e5-45dd-abaf-7c2b5087a503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9409503-e3e5-45dd-abaf-7c2b5087a503', 'volume_size': 1} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1691659308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9409503-e3e5-45dd-abaf-7c2b5087a503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609e6cdd90c646629787b2d9af1255a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:15Z,use_quota=True,user_id='705ee37b81d14d74a68356876336b8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Creating volume e9409503-e3e5-45dd-abaf-7c2b5087a503 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:28:14 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:28:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9409503-e3e5-45dd-abaf-7c2b5087a503 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:14 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9409503-e3e5-45dd-abaf-7c2b5087a503 1073741824 Aug 13 09:28:14 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:15 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9409503-e3e5-45dd-abaf-7c2b5087a503 1073741824" returned: 0 in 0.607s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9409503-e3e5-45dd-abaf-7c2b5087a503 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:15 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9409503-e3e5-45dd-abaf-7c2b5087a503 Aug 13 09:28:15 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:15 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9409503-e3e5-45dd-abaf-7c2b5087a503" returned: 0 in 0.464s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:28:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286a5640-6ac0-42fb-83bc-30194f6a96a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9409503-e3e5-45dd-abaf-7c2b5087a503', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39da3a8-63e1-40b7-a03f-5a6c87d047ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:16 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Volume volume-e9409503-e3e5-45dd-abaf-7c2b5087a503 (e9409503-e3e5-45dd-abaf-7c2b5087a503): created successfully Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39da3a8-63e1-40b7-a03f-5a6c87d047ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Flow 'volume_create_manager' (0cc92c22-385a-4e12-98f9-d8921e392a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Flow 'volume_create_manager' (19b56c54-e7e8-46d7-a65a-5a708f85fb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971069f4-560a-4fd3-8c5d-8853575c459c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:16 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-cb6aed24-73a6-49ad-831b-f26be8be5455 tempest-AttachVolumeTestJSON-488212827 None] Created volume successfully. Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971069f4-560a-4fd3-8c5d-8853575c459c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1895322952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57cdc8f-2d0c-4a66-a105-a53e28c6f04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c461a723dac4648a9097b742ab00f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:16Z,use_quota=True,user_id='ab58d06f794e44a28067b1e7c132bdd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa24567-446e-4e3c-8cb4-17a8771f6429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa24567-446e-4e3c-8cb4-17a8771f6429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409a7947-d522-438c-bebe-654460260da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409a7947-d522-438c-bebe-654460260da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c57cdc8f-2d0c-4a66-a105-a53e28c6f04e', 'volume_name': 'volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858d86ce-de66-4e50-82f2-7a590b6d6ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858d86ce-de66-4e50-82f2-7a590b6d6ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ce21fb-efda-4645-8b46-cfe653850526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:16 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Volume c57cdc8f-2d0c-4a66-a105-a53e28c6f04e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e', 'volume_size': 1} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1895322952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57cdc8f-2d0c-4a66-a105-a53e28c6f04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c461a723dac4648a9097b742ab00f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:16Z,use_quota=True,user_id='ab58d06f794e44a28067b1e7c132bdd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Creating volume c57cdc8f-2d0c-4a66-a105-a53e28c6f04e {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:28:16 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:16 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e 1073741824 Aug 13 09:28:16 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:16 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e 1073741824" returned: 0 in 0.454s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:16 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e Aug 13 09:28:16 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:16 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e" returned: 0 in 0.336s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ce21fb-efda-4645-8b46-cfe653850526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb656b83-118c-45da-a6ed-18f7fc1f507b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:17 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Volume volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e (c57cdc8f-2d0c-4a66-a105-a53e28c6f04e): created successfully Aug 13 09:28:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb656b83-118c-45da-a6ed-18f7fc1f507b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Flow 'volume_create_manager' (19b56c54-e7e8-46d7-a65a-5a708f85fb9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:17 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-8fecae2b-a9ad-44b5-9d2a-f49c4cc8738c tempest-VolumesTransfersTest-1492434188 None] Created volume successfully. Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Flow 'volume_create_manager' (697acb12-e9fe-46e6-8fbd-ee2fe41795ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2aa123-2b6f-499a-9649-d65e88473456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-fad97e1e-952a-45d9-8544-613d15d18927 req-508b1b94-83e3-43b6-9154-2570722175f2 tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-fad97e1e-952a-45d9-8544-613d15d18927 req-508b1b94-83e3-43b6-9154-2570722175f2 tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2aa123-2b6f-499a-9649-d65e88473456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-759296804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b5514e-7e78-447c-bc7a-dca77bc4947e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcfb2385cdfb400c922521e50187385c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:18Z,use_quota=True,user_id='1baf0b986ecd47ab9a4f517f311bb2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73dd7097-61a4-4a91-92af-af9485072fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73dd7097-61a4-4a91-92af-af9485072fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4af209-d9f8-44f3-b09c-2636fd4ccad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4af209-d9f8-44f3-b09c-2636fd4ccad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3b5514e-7e78-447c-bc7a-dca77bc4947e', 'volume_name': 'volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e', 'volume_size': 2}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45bf7bc-1ddc-4825-82ab-0431c7f1025c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45bf7bc-1ddc-4825-82ab-0431c7f1025c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b6bcda-a5c3-420d-9e35-09eb6c8599d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:18 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Volume b3b5514e-7e78-447c-bc7a-dca77bc4947e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e', 'volume_size': 2} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5b3288-ad4c-4935-ac13-4bb700b47ec6]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-fad97e1e-952a-45d9-8544-613d15d18927 req-508b1b94-83e3-43b6-9154-2570722175f2 tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9409503-e3e5-45dd-abaf-7c2b5087a503 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:18 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9409503-e3e5-45dd-abaf-7c2b5087a503 Aug 13 09:28:18 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:18 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-fad97e1e-952a-45d9-8544-613d15d18927 req-508b1b94-83e3-43b6-9154-2570722175f2 tempest-AttachVolumeTestJSON-488212827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9409503-e3e5-45dd-abaf-7c2b5087a503" returned: 0 in 0.419s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-fad97e1e-952a-45d9-8544-613d15d18927 req-508b1b94-83e3-43b6-9154-2570722175f2 tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.490s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.426s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-759296804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b5514e-7e78-447c-bc7a-dca77bc4947e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcfb2385cdfb400c922521e50187385c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:18Z,use_quota=True,user_id='1baf0b986ecd47ab9a4f517f311bb2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Creating volume b3b5514e-7e78-447c-bc7a-dca77bc4947e {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:28:18 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e 2147483648 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:18 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e 2147483648 Aug 13 09:28:18 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-fad97e1e-952a-45d9-8544-613d15d18927 req-508b1b94-83e3-43b6-9154-2570722175f2 tempest-AttachVolumeTestJSON-488212827 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-e9409503-e3e5-45dd-abaf-7c2b5087a503', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38f77075-160e-4890-b4b9-a38dd2f064ff', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:28:18 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-fad97e1e-952a-45d9-8544-613d15d18927 req-508b1b94-83e3-43b6-9154-2570722175f2 tempest-AttachVolumeTestJSON-488212827 None] attachment_update completed successfully. Aug 13 09:28:18 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-38023ffe-01cd-413a-aa69-4563f6f32c39 tempest-VolumesTransfersTest-1249422167 None] Transfer volume completed successfully. Aug 13 09:28:19 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e 2147483648" returned: 0 in 0.747s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:19 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e Aug 13 09:28:19 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Acquiring lock "cinder-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Lock "cinder-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:19 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e" returned: 0 in 0.348s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:28:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Acquiring lock "cinder-quobyte-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b6bcda-a5c3-420d-9e35-09eb6c8599d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e', 'volume_size': 2}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa24d60-bca4-4728-b64a-cb886963f4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Lock "cinder-quobyte-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e" acquired by "delete_volume" :: waited 0.053s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:19 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Volume volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e (b3b5514e-7e78-447c-bc7a-dca77bc4947e): created successfully Aug 13 09:28:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa24d60-bca4-4728-b64a-cb886963f4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Flow 'volume_create_manager' (697acb12-e9fe-46e6-8fbd-ee2fe41795ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:19 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a961a8b-ae93-4cd2-9de3-a813cb9ed05b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:19 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-0b491aa6-bcdc-4888-81d6-049fe4dceca4 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Created volume successfully. Aug 13 09:28:19 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e Aug 13 09:28:19 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:20 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e" returned: 0 in 0.464s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:20 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e Aug 13 09:28:20 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Creating offline snapshot 0742ca94-b572-4456-8161-d2bf2b1ef75b of volume b3b5514e-7e78-447c-bc7a-dca77bc4947e {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3976d508-1edf-48bd-95fa-a2dfa60c106a]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:20 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e Aug 13 09:28:20 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:20 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e" returned: 0 in 0.357s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Lock "cinder-quobyte-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e" released by "delete_volume" :: held 0.887s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Created reservations ['4ab23e4f-853d-40aa-8f03-2193f72bfb6d', '5cb2a271-4870-42a2-b23c-9ef4007576a3', '8f96313b-e186-4dbd-9e7f-3d82c9befe9b', '5402f632-64a7-419d-b57c-30dc0d0c5c71'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:20 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e" returned: 0 in 0.464s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b 2G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:20 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:20 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:20 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b 2G Aug 13 09:28:20 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:21 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.264s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:21 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:21 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Deleted volume successfully. Aug 13 09:28:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76784e30-f954-46f9-8766-060503871875 tempest-VolumesTransfersTest-989274464 None] Lock "cinder-c57cdc8f-2d0c-4a66-a105-a53e28c6f04e-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:21 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-fb1f418d-7db7-402c-93c1-201ae0e42259 req-2311f647-6217-4d21-8d39-78b7e398d5d1 tempest-AttachVolumeTestJSON-488212827 None] Terminate volume connection completed successfully. Aug 13 09:28:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-fb1f418d-7db7-402c-93c1-201ae0e42259 req-2311f647-6217-4d21-8d39-78b7e398d5d1 tempest-AttachVolumeTestJSON-488212827 None] Deleting attachment f9ff29c2-8af9-4d86-8445-a49a2529ed82. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:28:21 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b 2G" returned: 0 in 0.547s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:21 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b Aug 13 09:28:21 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:21 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b" returned: 0 in 0.348s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:21 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b is being set with open permissions: ugo+rw Aug 13 09:28:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:21 devstack sudo[103994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b Aug 13 09:28:21 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:22 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b" returned: 0 in 0.374s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:22 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.info Aug 13 09:28:22 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:22 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Flow 'volume_create_manager' (9128ce21-e92a-432c-9b82-701c25475321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f2a15e-7318-4c44-ba01-4a9bb2811563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.info" returned: 0 in 0.450s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:22 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.info is being set with open permissions: ugo+rw Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f2a15e-7318-4c44-ba01-4a9bb2811563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1404449930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec50bc97-a3f6-48eb-9eda-8671f2ea6159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c461a723dac4648a9097b742ab00f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:23Z,use_quota=True,user_id='ab58d06f794e44a28067b1e7c132bdd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e5ee60-20c0-453c-a77b-440870642258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:22 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.info Aug 13 09:28:22 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e5ee60-20c0-453c-a77b-440870642258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ba5c0a-2937-4b43-8d49-be4c589dc064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ba5c0a-2937-4b43-8d49-be4c589dc064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec50bc97-a3f6-48eb-9eda-8671f2ea6159', 'volume_name': 'volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818d642e-fe8a-4179-890d-d3338d7f053a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818d642e-fe8a-4179-890d-d3338d7f053a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c0f7fd-6bed-4376-a729-2f50817871b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:22 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Volume ec50bc97-a3f6-48eb-9eda-8671f2ea6159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159', 'volume_size': 1} Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:22 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-f5fa5631-93fe-46af-beec-fe8a0f87341a req-21cb83de-a807-48fb-984f-05ef6700c58e tempest-AttachVolumeTestJSON-488212827 None] Terminate volume connection completed successfully. Aug 13 09:28:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-f5fa5631-93fe-46af-beec-fe8a0f87341a req-21cb83de-a807-48fb-984f-05ef6700c58e tempest-AttachVolumeTestJSON-488212827 None] Deleting attachment 38f77075-160e-4890-b4b9-a38dd2f064ff. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:28:23 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.info" returned: 0 in 0.320s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.646s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.267s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1404449930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec50bc97-a3f6-48eb-9eda-8671f2ea6159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c461a723dac4648a9097b742ab00f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:23Z,use_quota=True,user_id='ab58d06f794e44a28067b1e7c132bdd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Creating volume ec50bc97-a3f6-48eb-9eda-8671f2ea6159 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:28:23 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:23 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159 1073741824 Aug 13 09:28:23 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:23 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-60c3f636-2062-48c9-9380-9b94708b29ce tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Create snapshot completed successfully Aug 13 09:28:23 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159 1073741824" returned: 0 in 0.571s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:23 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159 Aug 13 09:28:23 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Acquiring lock "cinder-0742ca94-b572-4456-8161-d2bf2b1ef75b-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "cinder-0742ca94-b572-4456-8161-d2bf2b1ef75b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Acquiring lock "cinder-quobyte-b3b5514e-7e78-447c-bc7a-dca77bc4947e" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "cinder-quobyte-b3b5514e-7e78-447c-bc7a-dca77bc4947e" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Acquiring lock "cinder-quobyte-0742ca94-b572-4456-8161-d2bf2b1ef75b" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "cinder-quobyte-0742ca94-b572-4456-8161-d2bf2b1ef75b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Deleting offline snapshot 0742ca94-b572-4456-8161-d2bf2b1ef75b of volume b3b5514e-7e78-447c-bc7a-dca77bc4947e {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] snapshot_file for this snap is: volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6111e40d-af47-4db1-8ebc-49dc10987482]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:24 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159" returned: 0 in 0.300s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:28:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c0f7fd-6bed-4376-a729-2f50817871b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e19381-32c6-47ef-b45a-24fd01abe4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:24 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Volume volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159 (ec50bc97-a3f6-48eb-9eda-8671f2ea6159): created successfully Aug 13 09:28:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e19381-32c6-47ef-b45a-24fd01abe4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Flow 'volume_create_manager' (9128ce21-e92a-432c-9b82-701c25475321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:24 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-9c21dc3a-b4e8-44e0-a046-c02f90e3e0ba tempest-VolumesTransfersTest-1492434188 None] Created volume successfully. Aug 13 09:28:24 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b Aug 13 09:28:24 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:24 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b" returned: 0 in 0.548s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:28:24 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9923e773-31e3-4f0a-8b86-ad9b2816124d]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:24 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e Aug 13 09:28:24 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Flow 'volume_create_manager' (a9e9300b-7ef3-469a-95f3-88ccb7e04db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ba2e54-8fd9-4a26-b3c5-216ca4bf1a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:25 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ba2e54-8fd9-4a26-b3c5-216ca4bf1a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1198446804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f8937c-06ce-472f-9c56-3d9576997e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f85f3f856c41dba86aa2ae99ea7e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:25Z,use_quota=True,user_id='9d70a712a26e4083a9728ff4082b8f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82432967-772d-4615-b493-c350990aa36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82432967-772d-4615-b493-c350990aa36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed2cbb5-baf1-4d53-b3f7-236a54de12cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed2cbb5-baf1-4d53-b3f7-236a54de12cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f8937c-06ce-472f-9c56-3d9576997e06', 'volume_name': 'volume-26f8937c-06ce-472f-9c56-3d9576997e06', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68644fce-a123-44c2-8a42-8884b27fe5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68644fce-a123-44c2-8a42-8884b27fe5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655e25b7-2fc2-4064-9849-531ea6bbe734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:25 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Volume 26f8937c-06ce-472f-9c56-3d9576997e06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f8937c-06ce-472f-9c56-3d9576997e06', 'volume_size': 1} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1198446804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f8937c-06ce-472f-9c56-3d9576997e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f85f3f856c41dba86aa2ae99ea7e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:25Z,use_quota=True,user_id='9d70a712a26e4083a9728ff4082b8f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Creating volume 26f8937c-06ce-472f-9c56-3d9576997e06 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:28:25 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e" returned: 0 in 0.795s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:25 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 1073741824 Aug 13 09:28:25 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:25 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b Aug 13 09:28:25 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Acquiring lock "cinder-ec50bc97-a3f6-48eb-9eda-8671f2ea6159-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Lock "cinder-ec50bc97-a3f6-48eb-9eda-8671f2ea6159-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Acquiring lock "cinder-quobyte-ec50bc97-a3f6-48eb-9eda-8671f2ea6159" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Lock "cinder-quobyte-ec50bc97-a3f6-48eb-9eda-8671f2ea6159" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[618097c6-41ce-47b5-a41f-ac31ade9debc]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:25 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159 Aug 13 09:28:25 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:25 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b" returned: 0 in 0.627s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:26 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b Aug 13 09:28:26 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:26 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159" returned: 0 in 0.551s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:26 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 1073741824" returned: 0 in 0.810s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:26 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159 Aug 13 09:28:26 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:26 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 Aug 13 09:28:26 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:26 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e.0742ca94-b572-4456-8161-d2bf2b1ef75b" returned: 0 in 0.381s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "cinder-quobyte-0742ca94-b572-4456-8161-d2bf2b1ef75b" released by "_delete_snapshot" :: held 2.501s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "cinder-quobyte-b3b5514e-7e78-447c-bc7a-dca77bc4947e" released by "delete_snapshot" :: held 2.530s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:26 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:26 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06" returned: 0 in 0.297s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Created reservations ['f2ac3afe-2dcb-46cb-9682-ac75034ed595', 'de7e8c29-3948-4323-a549-ab1f67b0695f', '34f3b572-d9bd-46e6-a1d4-b80be031a548', '4e660b4e-4983-4abf-acbb-168de8ffea69'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec50bc97-a3f6-48eb-9eda-8671f2ea6159" returned: 0 in 0.379s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655e25b7-2fc2-4064-9849-531ea6bbe734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f8937c-06ce-472f-9c56-3d9576997e06', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab7494c-87f7-4846-b5ad-b900783d6dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Lock "cinder-quobyte-ec50bc97-a3f6-48eb-9eda-8671f2ea6159" released by "delete_volume" :: held 1.000s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:26 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Volume volume-26f8937c-06ce-472f-9c56-3d9576997e06 (26f8937c-06ce-472f-9c56-3d9576997e06): created successfully Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab7494c-87f7-4846-b5ad-b900783d6dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Flow 'volume_create_manager' (a9e9300b-7ef3-469a-95f3-88ccb7e04db2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-4d942754-0747-4fcd-9f4d-a91ff07dadb2 tempest-VolumesCloneTest-39082539 None] Created volume successfully. Aug 13 09:28:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Delete snapshot completed successfully. Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e18622e-bbe6-4408-924f-24c4dd7254fc tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "cinder-0742ca94-b572-4456-8161-d2bf2b1ef75b-delete_snapshot" released by "delete_snapshot" :: held 2.871s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Created reservations ['4fb65af9-7e13-453b-a8c1-6dd89abbcb04', '4039e5a3-97b3-460d-ad11-d234df0b369f', 'a11137c8-4daf-4ffe-b11a-99a76eafe399', '2f2be863-c467-4913-b313-6efb74104953'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:26 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:26 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:27 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.311s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:27 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:27 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Deleted volume successfully. Aug 13 09:28:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4e4ae624-73ff-479b-aa63-a1a64ceccf7c tempest-VolumesTransfersTest-989274464 None] Lock "cinder-ec50bc97-a3f6-48eb-9eda-8671f2ea6159-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Acquiring lock "cinder-b3b5514e-7e78-447c-bc7a-dca77bc4947e-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "cinder-b3b5514e-7e78-447c-bc7a-dca77bc4947e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Acquiring lock "cinder-quobyte-b3b5514e-7e78-447c-bc7a-dca77bc4947e" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "cinder-quobyte-b3b5514e-7e78-447c-bc7a-dca77bc4947e" acquired by "delete_volume" :: waited 0.013s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:27 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[622343f1-7ec7-47fa-a0bc-2b4cb6dca1a2]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:27 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e Aug 13 09:28:27 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:27 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e" returned: 0 in 0.426s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:27 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e Aug 13 09:28:27 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:27 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:28:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Flow 'volume_create_manager' (f28b63fa-8ec2-4be4-a6d2-bf0ce7e38aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3056c421-31c8-402c-810f-41c530a0e12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3056c421-31c8-402c-810f-41c530a0e12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-455098340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c9535a-553a-4876-823a-b62dcdbccdc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f85f3f856c41dba86aa2ae99ea7e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=26f8937c-06ce-472f-9c56-3d9576997e06,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:28Z,use_quota=True,user_id='9d70a712a26e4083a9728ff4082b8f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78272b9a-7b92-4908-9c52-6e2d5784c6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78272b9a-7b92-4908-9c52-6e2d5784c6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da7a87e-30dd-48d5-8773-2610e07cb440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da7a87e-30dd-48d5-8773-2610e07cb440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f6c9535a-553a-4876-823a-b62dcdbccdc6', 'volume_name': 'volume-f6c9535a-553a-4876-823a-b62dcdbccdc6', 'volume_size': 2, 'source_volid': '26f8937c-06ce-472f-9c56-3d9576997e06', 'source_volstatus': 'available'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd0f5ea-dc94-444e-94d3-90b8b90cec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd0f5ea-dc94-444e-94d3-90b8b90cec5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d976a10c-9219-42be-bb8c-fd9d2e58c32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:28 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Volume f6c9535a-553a-4876-823a-b62dcdbccdc6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f6c9535a-553a-4876-823a-b62dcdbccdc6', 'volume_size': 2, 'source_volid': '26f8937c-06ce-472f-9c56-3d9576997e06', 'source_volstatus': 'available'} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:28 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Cloning volume 26f8937c-06ce-472f-9c56-3d9576997e06 to volume f6c9535a-553a-4876-823a-b62dcdbccdc6 Aug 13 09:28:28 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b3b5514e-7e78-447c-bc7a-dca77bc4947e" returned: 0 in 0.287s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Creating offline snapshot a4af71fe-032c-4731-8d94-bcef7b3af45d of volume 26f8937c-06ce-472f-9c56-3d9576997e06 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "cinder-quobyte-b3b5514e-7e78-447c-bc7a-dca77bc4947e" released by "delete_volume" :: held 0.786s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4078d9-20cf-4e5a-b0aa-5e84dc305f33]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Created reservations ['c119b2c0-9fef-4b92-b985-bf173fc9151d', 'deada3b5-12c2-4326-b90e-0f5f3bd95621', '9973a8be-0fc1-4485-b6c3-12525263f0ea', '16a11e95-cea6-4189-bf5d-498b7f488276'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:28 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 Aug 13 09:28:28 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:28 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:28 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:28 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.372s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:28 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Deleted volume successfully. Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-31386c32-f10e-426f-9f28-2c13f3337b35 tempest-VolumesSnapshotNegativeTestJSON-62164196 None] Lock "cinder-b3b5514e-7e78-447c-bc7a-dca77bc4947e-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:28 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06" returned: 0 in 0.756s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:28 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d 1G Aug 13 09:28:28 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:29 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d 1G" returned: 0 in 0.530s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26f8937c-06ce-472f-9c56-3d9576997e06 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:29 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26f8937c-06ce-472f-9c56-3d9576997e06 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d Aug 13 09:28:29 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "cinder-e9409503-e3e5-45dd-abaf-7c2b5087a503-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Lock "cinder-e9409503-e3e5-45dd-abaf-7c2b5087a503-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "cinder-quobyte-e9409503-e3e5-45dd-abaf-7c2b5087a503" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Lock "cinder-quobyte-e9409503-e3e5-45dd-abaf-7c2b5087a503" acquired by "delete_volume" :: waited 0.027s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:29 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[23db9ca2-f90f-49a6-be85-6e00340f0fb4]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9409503-e3e5-45dd-abaf-7c2b5087a503 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:29 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9409503-e3e5-45dd-abaf-7c2b5087a503 Aug 13 09:28:29 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:30 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26f8937c-06ce-472f-9c56-3d9576997e06 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d" returned: 0 in 0.532s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:30 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d is being set with open permissions: ugo+rw Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:30 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d Aug 13 09:28:30 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:30 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9409503-e3e5-45dd-abaf-7c2b5087a503" returned: 0 in 0.578s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9409503-e3e5-45dd-abaf-7c2b5087a503 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:30 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9409503-e3e5-45dd-abaf-7c2b5087a503 Aug 13 09:28:30 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:30 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d" returned: 0 in 0.394s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:30 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.info Aug 13 09:28:30 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:30 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e9409503-e3e5-45dd-abaf-7c2b5087a503" returned: 0 in 0.336s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Lock "cinder-quobyte-e9409503-e3e5-45dd-abaf-7c2b5087a503" released by "delete_volume" :: held 0.980s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Created reservations ['a1620824-e1db-4da3-9f0c-cc403e8bebac', '835d4f73-6c34-43b8-974d-eb58ba3f3c76', 'be88119a-87e4-4bae-a346-29da5506168a', 'd21b003b-92dd-465f-becc-acb735af5c40'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:30 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.info" returned: 0 in 0.406s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:30 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.info is being set with open permissions: ugo+rw Aug 13 09:28:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:30 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:30 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:30 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.info Aug 13 09:28:30 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:31 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.355s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:31 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Deleted volume successfully. Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f23f45b0-07b8-409b-a041-1ec95522f36d tempest-AttachVolumeTestJSON-488212827 None] Lock "cinder-e9409503-e3e5-45dd-abaf-7c2b5087a503-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:31 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.info" returned: 0 in 0.418s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Acquiring lock "cinder-quobyte-f6c9535a-553a-4876-823a-b62dcdbccdc6" by "_copy_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Lock "cinder-quobyte-f6c9535a-553a-4876-823a-b62dcdbccdc6" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] snapshot: a4af71fe-032c-4731-8d94-bcef7b3af45d, volume: f6c9535a-553a-4876-823a-b62dcdbccdc6, {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7086b5fe-e2cd-4a2b-8b9f-3afc903d7f7f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:31 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d Aug 13 09:28:31 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:31 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d" returned: 0 in 0.436s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26f8937c-06ce-472f-9c56-3d9576997e06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Creating direct copy from snapshot {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0e67b7-f168-46a3-a7e3-6b9f10d9b382]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "cinder-bf478dd1-159e-4af1-85a0-3a1970b88d0f-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Lock "cinder-bf478dd1-159e-4af1-85a0-3a1970b88d0f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "cinder-quobyte-bf478dd1-159e-4af1-85a0-3a1970b88d0f" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Lock "cinder-quobyte-bf478dd1-159e-4af1-85a0-3a1970b88d0f" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:32 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 Aug 13 09:28:32 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:32 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df4978a-bca2-4b4c-a340-caed00373916]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:32 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f Aug 13 09:28:32 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:32 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06" returned: 0 in 0.554s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:32 devstack cinder-volume[94670]: DEBUG cinder.utils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Path /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f6c9535a-553a-4876-823a-b62dcdbccdc6 not found in is_blk_device check {{(pid=94670) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 13 09:28:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f6c9535a-553a-4876-823a-b62dcdbccdc6 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:32 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f6c9535a-553a-4876-823a-b62dcdbccdc6 Aug 13 09:28:32 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:32 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f" returned: 0 in 0.497s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:32 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f Aug 13 09:28:32 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:32 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf478dd1-159e-4af1-85a0-3a1970b88d0f" returned: 0 in 0.324s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Lock "cinder-quobyte-bf478dd1-159e-4af1-85a0-3a1970b88d0f" released by "delete_volume" :: held 0.880s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:32 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Created reservations ['7c5262f7-bd54-4808-a9d2-752a0ebbd54c', 'e6ffe9fe-b001-467e-b6e3-245295f09188', 'e3ec53be-6d14-417d-928f-726b651a2f64', 'b45e8430-e3ae-4ef7-b2f0-de49a79502bf'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:33 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:33 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:33 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "cinder-247e8499-077d-4d5b-80ac-f9dc16b3630f-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:33 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Lock "cinder-247e8499-077d-4d5b-80ac-f9dc16b3630f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:33 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "cinder-quobyte-247e8499-077d-4d5b-80ac-f9dc16b3630f" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:33 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Lock "cinder-quobyte-247e8499-077d-4d5b-80ac-f9dc16b3630f" acquired by "delete_volume" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:33 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7319e1a-30a8-4af2-ad57-cd0519bc160d]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-247e8499-077d-4d5b-80ac-f9dc16b3630f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:33 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.803s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:33 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:33 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Deleted volume successfully. Aug 13 09:28:33 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-485b7c3a-f3af-4aa5-9d7a-d7219fca6e1c tempest-AttachVolumeTestJSON-488212827 None] Lock "cinder-bf478dd1-159e-4af1-85a0-3a1970b88d0f-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:34 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-247e8499-077d-4d5b-80ac-f9dc16b3630f Aug 13 09:28:34 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:34 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-247e8499-077d-4d5b-80ac-f9dc16b3630f" returned: 0 in 1.129s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-247e8499-077d-4d5b-80ac-f9dc16b3630f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:34 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-247e8499-077d-4d5b-80ac-f9dc16b3630f Aug 13 09:28:34 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:35 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-247e8499-077d-4d5b-80ac-f9dc16b3630f" returned: 0 in 0.439s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Lock "cinder-quobyte-247e8499-077d-4d5b-80ac-f9dc16b3630f" released by "delete_volume" :: held 1.740s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:35 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Created reservations ['ded550d5-5e65-4c55-9a56-685f79969452', '8274eb7a-d88a-4801-a5f4-482b143f7e19', 'b09882de-1714-4af9-9440-42c76548c9ab', 'b5c45dcc-9cc6-4cda-8849-ee3641f92e5d'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:36 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:36 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:37 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.589s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:37 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:37 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Deleted volume successfully. Aug 13 09:28:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-58541bdd-0588-4d13-a415-41498f4b7f9e tempest-AttachVolumeTestJSON-488212827 None] Lock "cinder-247e8499-077d-4d5b-80ac-f9dc16b3630f-delete_volume" released by "delete_volume" :: held 3.880s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:38 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f6c9535a-553a-4876-823a-b62dcdbccdc6" returned: 0 in 5.851s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:38 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a701cfe6-d2af-452d-829e-9e39263eeb11]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:38 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 Aug 13 09:28:38 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:38 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06" returned: 0 in 0.602s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:38 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Image conversion details: src /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f6c9535a-553a-4876-823a-b62dcdbccdc6 {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:28:38 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Converted 1024.00 MB image at 174.98 MB/s Aug 13 09:28:38 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f6c9535a-553a-4876-823a-b62dcdbccdc6 is being set with open permissions: ugo+rw Aug 13 09:28:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f6c9535a-553a-4876-823a-b62dcdbccdc6 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:38 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f6c9535a-553a-4876-823a-b62dcdbccdc6 Aug 13 09:28:38 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:39 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f6c9535a-553a-4876-823a-b62dcdbccdc6" returned: 0 in 0.270s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Lock "cinder-quobyte-f6c9535a-553a-4876-823a-b62dcdbccdc6" released by "_copy_volume_from_snapshot" :: held 7.823s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Acquiring lock "cinder-quobyte-a4af71fe-032c-4731-8d94-bcef7b3af45d" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Lock "cinder-quobyte-a4af71fe-032c-4731-8d94-bcef7b3af45d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Deleting offline snapshot a4af71fe-032c-4731-8d94-bcef7b3af45d of volume 26f8937c-06ce-472f-9c56-3d9576997e06 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] snapshot_file for this snap is: volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade18fcd-6673-4a98-b31a-4cb09b7ec014]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:39 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d Aug 13 09:28:39 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Flow 'volume_create_manager' (a3ff500c-24b7-480b-9500-8c69d00345cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e3024a-f326-4b21-80d3-4e2fe3173d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e3024a-f326-4b21-80d3-4e2fe3173d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-101476859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9ae818-2a76-4943-bd54-cec2d9ae90d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524cdcfa62ee4eae9a31eeb96c65fe46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:39Z,use_quota=True,user_id='feedaef6ba78449abaac10c74bb35258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ace50c0-c608-4346-9f03-bc67dd6c8e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ace50c0-c608-4346-9f03-bc67dd6c8e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f34587-aca0-4089-9fbe-745f4b341d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f34587-aca0-4089-9fbe-745f4b341d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9ae818-2a76-4943-bd54-cec2d9ae90d0', 'volume_name': 'volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0', 'volume_size': 2}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65388e23-1b5f-4596-ab86-308583239db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65388e23-1b5f-4596-ab86-308583239db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd1ee64-1bac-43b8-b127-5c5416a641ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:39 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Volume de9ae818-2a76-4943-bd54-cec2d9ae90d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0', 'volume_size': 2} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:39 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d" returned: 0 in 0.433s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26f8937c-06ce-472f-9c56-3d9576997e06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d97399-d7ed-489f-bce2-edb0137064f0]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:39 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 Aug 13 09:28:39 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:40 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06" returned: 0 in 0.470s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:40 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d Aug 13 09:28:40 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:40 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d" returned: 0 in 0.418s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:40 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d Aug 13 09:28:40 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:40 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06.a4af71fe-032c-4731-8d94-bcef7b3af45d" returned: 0 in 0.304s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Lock "cinder-quobyte-a4af71fe-032c-4731-8d94-bcef7b3af45d" released by "_delete_snapshot" :: held 1.786s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.968s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.410s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-101476859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9ae818-2a76-4943-bd54-cec2d9ae90d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524cdcfa62ee4eae9a31eeb96c65fe46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:39Z,use_quota=True,user_id='feedaef6ba78449abaac10c74bb35258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Creating volume de9ae818-2a76-4943-bd54-cec2d9ae90d0 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:28:41 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0 2147483648 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d976a10c-9219-42be-bb8c-fd9d2e58c32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c9535a-553a-4876-823a-b62dcdbccdc6', 'volume_size': 2, 'source_volid': '26f8937c-06ce-472f-9c56-3d9576997e06', 'source_volstatus': 'available'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:41 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0 2147483648 Aug 13 09:28:41 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef38ddd2-d19c-4876-a19c-fd57e5b53cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:41 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Volume volume-f6c9535a-553a-4876-823a-b62dcdbccdc6 (f6c9535a-553a-4876-823a-b62dcdbccdc6): created successfully Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef38ddd2-d19c-4876-a19c-fd57e5b53cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Flow 'volume_create_manager' (f28b63fa-8ec2-4be4-a6d2-bf0ce7e38aa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:41 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-76158ced-d4f8-422b-9005-ae0d6228648f tempest-VolumesCloneTest-39082539 None] Created volume successfully. Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Acquiring lock "cinder-f6c9535a-553a-4876-823a-b62dcdbccdc6-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Lock "cinder-f6c9535a-553a-4876-823a-b62dcdbccdc6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Acquiring lock "cinder-quobyte-f6c9535a-553a-4876-823a-b62dcdbccdc6" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Lock "cinder-quobyte-f6c9535a-553a-4876-823a-b62dcdbccdc6" acquired by "delete_volume" :: waited 0.028s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c73842-a9e5-499f-a653-9adcecaf7b04]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f6c9535a-553a-4876-823a-b62dcdbccdc6 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:41 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f6c9535a-553a-4876-823a-b62dcdbccdc6 Aug 13 09:28:41 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:41 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0 2147483648" returned: 0 in 0.720s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:41 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0 Aug 13 09:28:41 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:42 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f6c9535a-553a-4876-823a-b62dcdbccdc6" returned: 0 in 0.400s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f6c9535a-553a-4876-823a-b62dcdbccdc6 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:42 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f6c9535a-553a-4876-823a-b62dcdbccdc6 Aug 13 09:28:42 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:42 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0" returned: 0 in 0.264s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd1ee64-1bac-43b8-b127-5c5416a641ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0', 'volume_size': 2}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758a03d5-6cd5-4abe-9b11-7fca381e57d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:42 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Volume volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0 (de9ae818-2a76-4943-bd54-cec2d9ae90d0): created successfully Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758a03d5-6cd5-4abe-9b11-7fca381e57d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Flow 'volume_create_manager' (a3ff500c-24b7-480b-9500-8c69d00345cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:42 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b8f5695c-a117-427d-afca-e52a0480cd47 tempest-VolumesCloneNegativeTest-815378322 None] Created volume successfully. Aug 13 09:28:42 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f6c9535a-553a-4876-823a-b62dcdbccdc6" returned: 0 in 0.406s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Lock "cinder-quobyte-f6c9535a-553a-4876-823a-b62dcdbccdc6" released by "delete_volume" :: held 0.859s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Created reservations ['d7741372-5c24-4c90-af2f-9e016b69bcc3', '6d378631-18a0-45ba-be3d-b858a822d85e', 'f5109808-2bba-426a-9da4-fd66153e8b16', '26e01bdb-a806-4f49-b729-cbfdd273b3c0'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:42 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:42 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Acquiring lock "cinder-26f8937c-06ce-472f-9c56-3d9576997e06-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Lock "cinder-26f8937c-06ce-472f-9c56-3d9576997e06-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Acquiring lock "cinder-de9ae818-2a76-4943-bd54-cec2d9ae90d0-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Acquiring lock "cinder-quobyte-26f8937c-06ce-472f-9c56-3d9576997e06" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Lock "cinder-de9ae818-2a76-4943-bd54-cec2d9ae90d0-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Lock "cinder-quobyte-26f8937c-06ce-472f-9c56-3d9576997e06" acquired by "delete_volume" :: waited 0.040s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e0041b-341a-4851-9928-8be1110c18d0]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:43 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.563s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:43 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Deleted volume successfully. Aug 13 09:28:43 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:43 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:43 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 Aug 13 09:28:43 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Acquiring lock "cinder-quobyte-de9ae818-2a76-4943-bd54-cec2d9ae90d0" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ea3a96ad-3dc2-47eb-b3b6-26fa69ae3869 tempest-VolumesCloneTest-39082539 None] Lock "cinder-f6c9535a-553a-4876-823a-b62dcdbccdc6-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Lock "cinder-quobyte-de9ae818-2a76-4943-bd54-cec2d9ae90d0" acquired by "delete_volume" :: waited 0.060s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f01750-3c66-4e87-9062-4228be20dd48]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:43 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.323s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:28:43 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0 Aug 13 09:28:43 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:43 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06" returned: 0 in 0.572s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:43 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06 Aug 13 09:28:43 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:43 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0" returned: 0 in 0.544s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:44 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-26f8937c-06ce-472f-9c56-3d9576997e06" returned: 0 in 0.300s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:44 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0 Aug 13 09:28:44 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Lock "cinder-quobyte-26f8937c-06ce-472f-9c56-3d9576997e06" released by "delete_volume" :: held 0.997s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Created reservations ['425a1987-22cf-45d8-974a-e3474c03cc43', '396d19e7-b71b-4461-8176-7ffcb931fdf3', '63d9ebc3-2bf6-4315-9e89-6c9754be9ff4', '38f1431b-1096-4ce0-acff-362cdc2f28ca'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:44 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-de9ae818-2a76-4943-bd54-cec2d9ae90d0" returned: 0 in 0.598s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:44 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:44 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Lock "cinder-quobyte-de9ae818-2a76-4943-bd54-cec2d9ae90d0" released by "delete_volume" :: held 1.225s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Created reservations ['5d2966a0-a6f0-42f5-bca8-a6d0916bee72', 'f40d0232-67f3-4dc7-90f0-37dc65d11839', '03f925c9-edf2-4513-b12d-50f40c598747', '37c5279c-4d5d-42be-91b5-0620603124c1'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:44 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:44 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:44 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.423s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:44 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Deleted volume successfully. Aug 13 09:28:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cc6ee9c4-010d-4013-806c-c2d1f4f62b76 tempest-VolumesCloneTest-39082539 None] Lock "cinder-26f8937c-06ce-472f-9c56-3d9576997e06-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:45 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.342s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:45 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:45 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Deleted volume successfully. Aug 13 09:28:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9fa15007-ca7d-4d18-950d-64aa03bba799 tempest-VolumesCloneNegativeTest-815378322 None] Lock "cinder-de9ae818-2a76-4943-bd54-cec2d9ae90d0-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Flow 'volume_create_manager' (0ad25eb2-120d-47e8-b650-8a205446556b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc2e978-fbe1-4d08-8d20-fb22245b542c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc2e978-fbe1-4d08-8d20-fb22245b542c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-743540354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0d2b79-7e09-4836-b31f-b04176174c84,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9516b5872b0b43e8b9e7a4bd3ccae250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:50Z,use_quota=True,user_id='632ccc0233dd4e459d963d666520f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ef3856-9671-4b8b-96cd-2afed2340b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ef3856-9671-4b8b-96cd-2afed2340b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ba45d0-9f6f-44f5-9fe2-d627a0a85fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ba45d0-9f6f-44f5-9fe2-d627a0a85fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0d2b79-7e09-4836-b31f-b04176174c84', 'volume_name': 'volume-4b0d2b79-7e09-4836-b31f-b04176174c84', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138c6a72-fd0a-49f5-a775-933c9da59321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138c6a72-fd0a-49f5-a775-933c9da59321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f3f9ee-47ac-4f29-b91b-07aeda2009f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:50 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Volume 4b0d2b79-7e09-4836-b31f-b04176174c84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0d2b79-7e09-4836-b31f-b04176174c84', 'volume_size': 1} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-743540354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0d2b79-7e09-4836-b31f-b04176174c84,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9516b5872b0b43e8b9e7a4bd3ccae250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:50Z,use_quota=True,user_id='632ccc0233dd4e459d963d666520f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Creating volume 4b0d2b79-7e09-4836-b31f-b04176174c84 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:28:50 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4b0d2b79-7e09-4836-b31f-b04176174c84 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:50 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4b0d2b79-7e09-4836-b31f-b04176174c84 1073741824 Aug 13 09:28:50 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:50 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4b0d2b79-7e09-4836-b31f-b04176174c84 1073741824" returned: 0 in 0.664s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4b0d2b79-7e09-4836-b31f-b04176174c84 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:50 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4b0d2b79-7e09-4836-b31f-b04176174c84 Aug 13 09:28:50 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:51 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4b0d2b79-7e09-4836-b31f-b04176174c84" returned: 0 in 0.520s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:28:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f3f9ee-47ac-4f29-b91b-07aeda2009f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0d2b79-7e09-4836-b31f-b04176174c84', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8147d2-64d6-4e3a-959a-2813e9e79fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:51 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Volume volume-4b0d2b79-7e09-4836-b31f-b04176174c84 (4b0d2b79-7e09-4836-b31f-b04176174c84): created successfully Aug 13 09:28:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8147d2-64d6-4e3a-959a-2813e9e79fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Flow 'volume_create_manager' (0ad25eb2-120d-47e8-b650-8a205446556b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:51 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6dbbb83f-5c1c-4e26-8545-9ff9d11419e0 tempest-VolumesGetTest-469370970 None] Created volume successfully. Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Flow 'volume_create_manager' (6bbe722d-ef6b-4d4c-9261-df4aaf82ed73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5a7fe4-6cc0-40a1-b956-1269fd6c8d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5a7fe4-6cc0-40a1-b956-1269fd6c8d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1871435970',display_name='tempest-VolumesGetTest-Volume-714623372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e6661b-f70c-4fdd-8c07-8e13b82b09b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9516b5872b0b43e8b9e7a4bd3ccae250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:53Z,use_quota=True,user_id='632ccc0233dd4e459d963d666520f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897f162d-57f3-4d83-bcbc-844a83364332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897f162d-57f3-4d83-bcbc-844a83364332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00123d9a-2161-49af-b472-c134adde91bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00123d9a-2161-49af-b472-c134adde91bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2e6661b-f70c-4fdd-8c07-8e13b82b09b9', 'volume_name': 'volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8494be-c1c6-4e48-b692-ce49fec7d6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8494be-c1c6-4e48-b692-ce49fec7d6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e46623-518f-44ba-b9a5-a6765e488ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:53 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Volume d2e6661b-f70c-4fdd-8c07-8e13b82b09b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9', 'volume_size': 1} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1871435970',display_name='tempest-VolumesGetTest-Volume-714623372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e6661b-f70c-4fdd-8c07-8e13b82b09b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9516b5872b0b43e8b9e7a4bd3ccae250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:53Z,use_quota=True,user_id='632ccc0233dd4e459d963d666520f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Creating volume d2e6661b-f70c-4fdd-8c07-8e13b82b09b9 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:28:53 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:28:53 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9 1073741824 Aug 13 09:28:53 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Flow 'volume_create_manager' (12573f00-a854-438c-b488-fc9fd2181a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d279a5c9-9b83-49c4-8476-750e2003ef9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d279a5c9-9b83-49c4-8476-750e2003ef9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-160056284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49d3e32-d7ba-4ef1-a630-bf64ea67b90f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2b423050b54d62adfebe52c6bd816d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:53Z,use_quota=True,user_id='fb5c7dcbf0f74cfab0231f8002630cd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d811cd1-8acf-4670-be3c-ba90deac5b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d811cd1-8acf-4670-be3c-ba90deac5b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a868cf4a-be9b-4598-89ef-00c9f3420436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:53 devstack cinder-volume[94670]: DEBUG cinder.image.glance [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Creating Keystone auth plugin from conf {{(pid=94670) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a868cf4a-be9b-4598-89ef-00c9f3420436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c49d3e32-d7ba-4ef1-a630-bf64ea67b90f', 'volume_name': 'volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f', 'volume_size': 1, 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3c2349994ac4b0198f93975c909efdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'created_at': datetime.datetime(2026, 8, 13, 7, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 15, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1330bb5-9d27-4913-888d-485e4ed28bd9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9b4e0f-6446-4817-9f45-25dcf67d06ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:54 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9b4e0f-6446-4817-9f45-25dcf67d06ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b6a195-6c4d-4590-a196-0e585d17511d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:54 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Volume c49d3e32-d7ba-4ef1-a630-bf64ea67b90f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f', 'volume_size': 1, 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3c2349994ac4b0198f93975c909efdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'created_at': datetime.datetime(2026, 8, 13, 7, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 15, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1330bb5-9d27-4913-888d-485e4ed28bd9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Trying to clone c49d3e32-d7ba-4ef1-a630-bf64ea67b90f from image b1330bb5-9d27-4913-888d-485e4ed28bd9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]). {{(pid=94670) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9 1073741824" returned: 0 in 0.577s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:54 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9 Aug 13 09:28:54 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:54 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_zw5q2e_xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 13 09:28:54 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Image download 20.69 MB at 20.69 MB/s Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9" returned: 0 in 0.425s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e46623-518f-44ba-b9a5-a6765e488ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2db694-8c74-44e6-b616-59dff596b2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:28:54 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Volume volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9 (d2e6661b-f70c-4fdd-8c07-8e13b82b09b9): created successfully Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2db694-8c74-44e6-b616-59dff596b2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Flow 'volume_create_manager' (6bbe722d-ef6b-4d4c-9261-df4aaf82ed73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6bafb5-5189-4a5f-aaf3-f19617335adf]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_zw5q2e_xdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:54 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-01c90e13-21d9-4149-8848-6aeeca0d49ba tempest-VolumesGetTest-469370970 None] Created volume successfully. Aug 13 09:28:54 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_zw5q2e_xdevstack@QuobyteHD Aug 13 09:28:54 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:55 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_zw5q2e_xdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Temporary image b1330bb5-9d27-4913-888d-485e4ed28bd9 is fetched for user fb5c7dcbf0f74cfab0231f8002630cd1. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd20f48c-1b41-4220-a379-dbf2189427fc]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_zw5q2e_xdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:55 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_zw5q2e_xdevstack@QuobyteHD Aug 13 09:28:55 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Lock "cinder-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:55 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-quobyte-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_zw5q2e_xdevstack@QuobyteHD" returned: 0 in 0.534s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-160056284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49d3e32-d7ba-4ef1-a630-bf64ea67b90f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2b423050b54d62adfebe52c6bd816d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:28:53Z,use_quota=True,user_id='fb5c7dcbf0f74cfab0231f8002630cd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Creating volume c49d3e32-d7ba-4ef1-a630-bf64ea67b90f {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:28:55 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9" acquired by "delete_volume" :: waited 0.056s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:55 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f 1073741824 Aug 13 09:28:55 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0df827-3c75-43c7-8b11-75b41ddd2e70]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:55 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9 Aug 13 09:28:55 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:56 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9" returned: 0 in 0.536s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:56 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9 Aug 13 09:28:56 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:56 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f 1073741824" returned: 0 in 0.734s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:56 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f Aug 13 09:28:56 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:56 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9" returned: 0 in 0.409s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9" released by "delete_volume" :: held 1.018s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:56 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f" returned: 0 in 0.306s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:28:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:56 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Attempting download of b1330bb5-9d27-4913-888d-485e4ed28bd9 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}])) to volume c49d3e32-d7ba-4ef1-a630-bf64ea67b90f. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 13 09:28:56 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Created reservations ['5089e225-0372-44f8-91ec-3f9888b22c4b', 'fc069c23-54c9-43d5-b121-f20f8487f06a', '2cb33679-4c39-41a6-a703-2d7c91c0e134', 'b59fa966-7e26-42c6-bfce-939c7a37019c'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:56 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e3f83e-65a6-4556-b910-6c6184ac0286]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_zqgfnz7t {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:57 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:57 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:57 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_zqgfnz7t Aug 13 09:28:57 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:57 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.367s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:57 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:57 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Deleted volume successfully. Aug 13 09:28:57 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_zqgfnz7t" returned: 0 in 0.466s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_zqgfnz7t {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-064b0477-b127-4d6f-b0b3-24af1e669295 tempest-VolumesGetTest-469370970 None] Lock "cinder-d2e6661b-f70c-4fdd-8c07-8e13b82b09b9-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:57 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_zqgfnz7t Aug 13 09:28:57 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:57 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_zqgfnz7t" returned: 1 in 0.418s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_zqgfnz7t' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:28:57 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfdcdd1-70be-4a42-bb37-e1a8a618da5c]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_zw5q2e_xdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:58 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_zw5q2e_xdevstack@QuobyteHD Aug 13 09:28:58 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-4b0d2b79-7e09-4836-b31f-b04176174c84-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Lock "cinder-4b0d2b79-7e09-4836-b31f-b04176174c84-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-quobyte-4b0d2b79-7e09-4836-b31f-b04176174c84" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:28:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-4b0d2b79-7e09-4836-b31f-b04176174c84" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:28:58 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f74e3d-f6a2-4af5-a660-9985c3b92ff5]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:28:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4b0d2b79-7e09-4836-b31f-b04176174c84 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:58 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_zw5q2e_xdevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:58 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] b1330bb5-9d27-4913-888d-485e4ed28bd9 was qcow2, converting to raw {{(pid=94670) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 13 09:28:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_zw5q2e_xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:58 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_zw5q2e_xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f Aug 13 09:28:58 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:58 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4b0d2b79-7e09-4836-b31f-b04176174c84 Aug 13 09:28:58 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:58 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4b0d2b79-7e09-4836-b31f-b04176174c84" returned: 0 in 0.493s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4b0d2b79-7e09-4836-b31f-b04176174c84 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:58 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4b0d2b79-7e09-4836-b31f-b04176174c84 Aug 13 09:28:58 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:59 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4b0d2b79-7e09-4836-b31f-b04176174c84" returned: 0 in 0.332s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:59 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-4b0d2b79-7e09-4836-b31f-b04176174c84" released by "delete_volume" :: held 0.901s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:28:59 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Created reservations ['93cfa8bf-3f01-4531-8e0c-0ada52decb3d', '27f4cb02-ab90-4fb2-9930-2634b175f081', 'f8110d20-47aa-44eb-b4c7-69b544b74794', '5e40cc57-6585-4b1b-bf08-9499a6cd48f7'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:28:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:28:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:28:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:28:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:28:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:28:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:28:59 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:28:59 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:28:59 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Aug 13 09:28:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.402s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:28:59 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:28:59 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Deleted volume successfully. Aug 13 09:28:59 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a119c81c-026b-48a5-ad4e-f0c3cd86ca61 tempest-VolumesGetTest-469370970 None] Lock "cinder-4b0d2b79-7e09-4836-b31f-b04176174c84-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:00 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_zw5q2e_xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f" returned: 0 in 2.230s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:00 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_zw5q2e_xdevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:29:00 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Converted 112.00 MB image at 50.19 MB/s Aug 13 09:29:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:00 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f 1G Aug 13 09:29:00 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:01 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f 1G" returned: 0 in 0.508s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[423bcfa0-ff4d-4a30-aa85-af20b8fd54c0]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Flow 'volume_create_manager' (c44cd56c-9013-438f-9c3c-633f6ee848ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81fad152-2188-47d3-a1a8-bdeccec55093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81fad152-2188-47d3-a1a8-bdeccec55093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1166403617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd33cc9f-9e87-4111-b42f-b5138db5ff99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9516b5872b0b43e8b9e7a4bd3ccae250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:01Z,use_quota=True,user_id='632ccc0233dd4e459d963d666520f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dfba74-28dc-49b0-9d1f-e24e5ef53630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dfba74-28dc-49b0-9d1f-e24e5ef53630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3a02e2-8167-44b4-b65f-9d4530d0a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3a02e2-8167-44b4-b65f-9d4530d0a34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd33cc9f-9e87-4111-b42f-b5138db5ff99', 'volume_name': 'volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f831f153-0e62-45b4-95ff-6808224ef226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f831f153-0e62-45b4-95ff-6808224ef226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e892f9-8b5f-4cd9-bbe7-e6f3763a52b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:01 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Volume cd33cc9f-9e87-4111-b42f-b5138db5ff99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99', 'volume_size': 1} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1166403617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd33cc9f-9e87-4111-b42f-b5138db5ff99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9516b5872b0b43e8b9e7a4bd3ccae250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:01Z,use_quota=True,user_id='632ccc0233dd4e459d963d666520f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Creating volume cd33cc9f-9e87-4111-b42f-b5138db5ff99 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:29:01 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:01 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 1073741824 Aug 13 09:29:01 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:01 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f Aug 13 09:29:01 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:01 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f" returned: 0 in 0.607s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:01 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f Aug 13 09:29:01 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:01 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 1073741824" returned: 0 in 0.576s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:02 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 Aug 13 09:29:02 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:02 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f" returned: 1 in 0.413s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Downloaded image b1330bb5-9d27-4913-888d-485e4ed28bd9 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}])) to volume c49d3e32-d7ba-4ef1-a630-bf64ea67b90f successfully. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Temporary image b1330bb5-9d27-4913-888d-485e4ed28bd9 for user fb5c7dcbf0f74cfab0231f8002630cd1 is deleted. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Marking volume c49d3e32-d7ba-4ef1-a630-bf64ea67b90f as bootable. {{(pid=94670) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Copying metadata from image b1330bb5-9d27-4913-888d-485e4ed28bd9 to c49d3e32-d7ba-4ef1-a630-bf64ea67b90f. {{(pid=94670) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Creating volume glance metadata for volume c49d3e32-d7ba-4ef1-a630-bf64ea67b90f backed by image b1330bb5-9d27-4913-888d-485e4ed28bd9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94670) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 13 09:29:02 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99" returned: 0 in 0.316s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e892f9-8b5f-4cd9-bbe7-e6f3763a52b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a377916-4ca6-41a1-969a-2fe4d69b60a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:02 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Volume volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 (cd33cc9f-9e87-4111-b42f-b5138db5ff99): created successfully Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a377916-4ca6-41a1-969a-2fe4d69b60a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Flow 'volume_create_manager' (c44cd56c-9013-438f-9c3c-633f6ee848ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:02 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-967c9e6e-9cd4-458f-8c0f-eadaab4cdb8f tempest-VolumesGetTest-469370970 None] Created volume successfully. Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b6a195-6c4d-4590-a196-0e585d17511d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f', 'volume_size': 1, 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3c2349994ac4b0198f93975c909efdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'created_at': datetime.datetime(2026, 8, 13, 7, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 15, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1330bb5-9d27-4913-888d-485e4ed28bd9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b558d69f-623a-4bcd-8ef6-6d6051479e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:02 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Volume volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f (c49d3e32-d7ba-4ef1-a630-bf64ea67b90f): created successfully Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b558d69f-623a-4bcd-8ef6-6d6051479e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Flow 'volume_create_manager' (12573f00-a854-438c-b488-fc9fd2181a3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:02 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-57c43f6c-e976-4011-b442-e99a1a125160 tempest-VolumesExtendTest-1132438090 None] Created volume successfully. Aug 13 09:29:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8dde3e0d-cabf-4ba9-81c6-3b8af0b00172 tempest-VolumesExtendTest-1132438090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8dde3e0d-cabf-4ba9-81c6-3b8af0b00172 tempest-VolumesExtendTest-1132438090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:03 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b3e62f-0e8c-4f0d-8739-3319aeba9397]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8dde3e0d-cabf-4ba9-81c6-3b8af0b00172 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:03 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f Aug 13 09:29:03 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:03 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8dde3e0d-cabf-4ba9-81c6-3b8af0b00172 tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f" returned: 0 in 0.452s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8dde3e0d-cabf-4ba9-81c6-3b8af0b00172 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:03 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f Aug 13 09:29:03 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Flow 'volume_create_manager' (f057ed00-9952-4277-9826-f73cd4eb151f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48366978-982b-47fa-836e-343a29e0c9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48366978-982b-47fa-836e-343a29e0c9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-729352194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09664425-9771-4fe0-bc5d-a2f30fe8b1ad,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9516b5872b0b43e8b9e7a4bd3ccae250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cd33cc9f-9e87-4111-b42f-b5138db5ff99,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:04Z,use_quota=True,user_id='632ccc0233dd4e459d963d666520f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c951ee-52be-434c-8316-1988c59f7c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c951ee-52be-434c-8316-1988c59f7c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007e981d-b710-4a0b-9a87-dccd53061526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007e981d-b710-4a0b-9a87-dccd53061526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '09664425-9771-4fe0-bc5d-a2f30fe8b1ad', 'volume_name': 'volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad', 'volume_size': 1, 'source_volid': 'cd33cc9f-9e87-4111-b42f-b5138db5ff99', 'source_volstatus': 'available'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbb6fe3-7ca8-476b-93aa-cd827adeee09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbb6fe3-7ca8-476b-93aa-cd827adeee09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e412576a-edf3-49c9-9d78-9f45a2004cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:04 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Volume 09664425-9771-4fe0-bc5d-a2f30fe8b1ad: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad', 'volume_size': 1, 'source_volid': 'cd33cc9f-9e87-4111-b42f-b5138db5ff99', 'source_volstatus': 'available'} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:04 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8dde3e0d-cabf-4ba9-81c6-3b8af0b00172 tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f" returned: 1 in 0.626s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8dde3e0d-cabf-4ba9-81c6-3b8af0b00172 tempest-VolumesExtendTest-1132438090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8dde3e0d-cabf-4ba9-81c6-3b8af0b00172 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f 2G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8dde3e0d-cabf-4ba9-81c6-3b8af0b00172 tempest-VolumesExtendTest-1132438090 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f 2G" returned: 0 in 0.083s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8dde3e0d-cabf-4ba9-81c6-3b8af0b00172 tempest-VolumesExtendTest-1132438090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.223s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.174s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:04 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Cloning volume cd33cc9f-9e87-4111-b42f-b5138db5ff99 to volume 09664425-9771-4fe0-bc5d-a2f30fe8b1ad Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Creating offline snapshot 70c097ac-ea95-4ff8-921a-9fd9c14d6f29 of volume cd33cc9f-9e87-4111-b42f-b5138db5ff99 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:29:04 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-8dde3e0d-cabf-4ba9-81c6-3b8af0b00172 tempest-VolumesExtendTest-1132438090 None] Extend volume completed successfully. Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e5ea12-b5a1-4a72-b968-c1c540b2b582]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:04 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 Aug 13 09:29:04 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:04 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99" returned: 0 in 0.425s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:04 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 1G Aug 13 09:29:04 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:05 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 1G" returned: 0 in 0.528s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:05 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 Aug 13 09:29:05 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Acquiring lock "cinder-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Lock "cinder-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Acquiring lock "cinder-quobyte-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Lock "cinder-quobyte-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f" acquired by "delete_volume" :: waited 0.033s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:05 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29" returned: 0 in 0.421s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:05 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 is being set with open permissions: ugo+rw Aug 13 09:29:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:05 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[38542791-5c71-4929-8cf4-9dba3f1db69e]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:05 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 Aug 13 09:29:05 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:05 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f Aug 13 09:29:05 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:06 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29" returned: 0 in 0.427s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:06 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.info Aug 13 09:29:06 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:06 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f" returned: 0 in 0.530s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:06 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f Aug 13 09:29:06 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:06 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.info" returned: 0 in 0.299s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:06 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.info is being set with open permissions: ugo+rw Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:06 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.info Aug 13 09:29:06 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:06 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f" returned: 1 in 0.458s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:06 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f Aug 13 09:29:06 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:06 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.info" returned: 0 in 0.322s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-quobyte-09664425-9771-4fe0-bc5d-a2f30fe8b1ad" by "_copy_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-09664425-9771-4fe0-bc5d-a2f30fe8b1ad" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] snapshot: 70c097ac-ea95-4ff8-921a-9fd9c14d6f29, volume: 09664425-9771-4fe0-bc5d-a2f30fe8b1ad, {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4de752-ee58-417c-9acd-c4d77b0ec6e1]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:07 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f" returned: 0 in 0.317s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Lock "cinder-quobyte-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f" released by "delete_volume" :: held 1.424s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:07 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 Aug 13 09:29:07 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Created reservations ['1006d17b-a000-495e-965f-357a34b7ba6f', 'b0a604d9-e330-4480-a46e-48c91eeefc49', '10bc8146-62a6-40d2-8631-4aacc1d416a9', 'c95a413a-96e2-495a-bb02-70e87de32924'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:07 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:29:07 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:07 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29" returned: 0 in 0.647s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Creating direct copy from snapshot {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4bddb7-7d2a-4f0a-8be7-5ed21ae1b293]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:07 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.368s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:29:07 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Deleted volume successfully. Aug 13 09:29:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-0deaba07-353e-4d79-beff-5ca87e5f0cd7 tempest-VolumesExtendTest-1132438090 None] Lock "cinder-c49d3e32-d7ba-4ef1-a630-bf64ea67b90f-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:07 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 Aug 13 09:29:07 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:08 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99" returned: 0 in 0.822s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:08 devstack cinder-volume[94670]: DEBUG cinder.utils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Path /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad not found in is_blk_device check {{(pid=94670) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 13 09:29:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:08 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad Aug 13 09:29:08 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:08 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:29:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Flow 'volume_create_manager' (419dc8e4-e854-43b5-bc2d-dd27bf6f55d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a846abe5-b8bd-4efc-8c6c-22292f70eefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a846abe5-b8bd-4efc-8c6c-22292f70eefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-320648690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0e4c72-f315-458b-966c-f83d8d6e11a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2b423050b54d62adfebe52c6bd816d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:09Z,use_quota=True,user_id='fb5c7dcbf0f74cfab0231f8002630cd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047ce2b9-1735-4922-aab5-32bc497d18e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047ce2b9-1735-4922-aab5-32bc497d18e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776d6979-cb9d-4096-a3aa-3d35021605ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776d6979-cb9d-4096-a3aa-3d35021605ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0e4c72-f315-458b-966c-f83d8d6e11a0', 'volume_name': 'volume-be0e4c72-f315-458b-966c-f83d8d6e11a0', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fee2e2-ffc3-4689-8061-a4030a8917e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fee2e2-ffc3-4689-8061-a4030a8917e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbae07f2-4b57-460f-ad6e-5631f59361aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:09 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Volume be0e4c72-f315-458b-966c-f83d8d6e11a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0e4c72-f315-458b-966c-f83d8d6e11a0', 'volume_size': 1} Aug 13 09:29:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:14 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad" returned: 0 in 6.475s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:15 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f2aab5-7534-42d1-8dc1-8d76d13d638c]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:15 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 Aug 13 09:29:15 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:15 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99" returned: 0 in 0.662s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:15 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Image conversion details: src /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:29:15 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Converted 1024.00 MB image at 158.12 MB/s Aug 13 09:29:15 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad is being set with open permissions: ugo+rw Aug 13 09:29:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:15 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad Aug 13 09:29:15 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:16 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad" returned: 0 in 0.339s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-09664425-9771-4fe0-bc5d-a2f30fe8b1ad" released by "_copy_volume_from_snapshot" :: held 9.072s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:16 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=116,cinder:UPDATE=150,cinder:INSERT=39,cinder:DELETE=11 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:29:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-quobyte-70c097ac-ea95-4ff8-921a-9fd9c14d6f29" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-70c097ac-ea95-4ff8-921a-9fd9c14d6f29" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Deleting offline snapshot 70c097ac-ea95-4ff8-921a-9fd9c14d6f29 of volume cd33cc9f-9e87-4111-b42f-b5138db5ff99 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:29:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] snapshot_file for this snap is: volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:29:16 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2595d535-2e32-4e0a-bcc1-837dc39936e8]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:16 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 Aug 13 09:29:16 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:16 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29" returned: 0 in 0.646s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:29:16 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e52f505-20b6-488f-a901-bf0d375608fb]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:17 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 Aug 13 09:29:17 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:17 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=117,cinder:INSERT=42,cinder:UPDATE=140,cinder:DELETE=13 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:29:17 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:29:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Flow 'volume_create_manager' (32125b07-be18-42e9-a673-3efad5146cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb0f573-9589-48e3-a293-578ea959f311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb0f573-9589-48e3-a293-578ea959f311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1873594432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e91912df342f4226916aeed106f26776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:17Z,use_quota=True,user_id='9b66fe00b8a1422eacca0586216376da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a58f3ae-71d7-48d1-8151-bc8b5ba931d9),volume_type_id=6a58f3ae-71d7-48d1-8151-bc8b5ba931d9)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c072ae-b6ff-4f4b-971c-1887ddea3784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c072ae-b6ff-4f4b-971c-1887ddea3784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dad2b95-6656-43d8-a071-63aac425c1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dad2b95-6656-43d8-a071-63aac425c1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b', 'volume_name': 'volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:17 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9970a27b-c802-4868-85f4-77f17e51da6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9970a27b-c802-4868-85f4-77f17e51da6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7588aa18-80e9-4d34-a4ed-bb9d916ec549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:17 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Volume 3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b', 'volume_size': 1} Aug 13 09:29:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99" returned: 0 in 0.862s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:17 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 Aug 13 09:29:17 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Flow 'volume_create_manager' (097a9032-2a4b-49c2-937d-dcd5180f8abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b957009-4124-4ad5-a013-b68b09ead2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b957009-4124-4ad5-a013-b68b09ead2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2139086994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee79052-34f2-4d34-ae26-bc7a36ddf162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e91912df342f4226916aeed106f26776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:18Z,use_quota=True,user_id='9b66fe00b8a1422eacca0586216376da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ab3ff00-9811-4967-be2f-dde499057cc0),volume_type_id=6ab3ff00-9811-4967-be2f-dde499057cc0)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc9c77b-29a0-493a-b6ea-527aefb3959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc9c77b-29a0-493a-b6ea-527aefb3959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d73ffd-75b9-4adc-9eb1-e9dd659dfff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d73ffd-75b9-4adc-9eb1-e9dd659dfff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ee79052-34f2-4d34-ae26-bc7a36ddf162', 'volume_name': 'volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f7ab50-d136-419b-a3d1-bf2574434947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f7ab50-d136-419b-a3d1-bf2574434947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d3d6c0-a140-4be8-8578-18e3e832af2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:18 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Volume 7ee79052-34f2-4d34-ae26-bc7a36ddf162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162', 'volume_size': 1} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:18 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29" returned: 0 in 0.586s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:18 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29 Aug 13 09:29:18 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:18 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99.70c097ac-ea95-4ff8-921a-9fd9c14d6f29" returned: 0 in 0.308s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-70c097ac-ea95-4ff8-921a-9fd9c14d6f29" released by "_delete_snapshot" :: held 2.563s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.346s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.665s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-320648690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0e4c72-f315-458b-966c-f83d8d6e11a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2b423050b54d62adfebe52c6bd816d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:09Z,use_quota=True,user_id='fb5c7dcbf0f74cfab0231f8002630cd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Creating volume be0e4c72-f315-458b-966c-f83d8d6e11a0 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:29:18 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:18 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 1073741824 Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e412576a-edf3-49c9-9d78-9f45a2004cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad', 'volume_size': 1, 'source_volid': 'cd33cc9f-9e87-4111-b42f-b5138db5ff99', 'source_volstatus': 'available'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:18 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce81387-71db-4354-909d-b7415264cb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Flow 'volume_create_manager' (68597b5c-b54d-4284-999f-62395651780f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6105f40-fb8a-4a8c-a3d5-d388b896ecbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:18 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Volume volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad (09664425-9771-4fe0-bc5d-a2f30fe8b1ad): created successfully Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce81387-71db-4354-909d-b7415264cb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Flow 'volume_create_manager' (f057ed00-9952-4277-9826-f73cd4eb151f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6105f40-fb8a-4a8c-a3d5-d388b896ecbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1367895756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789e1754-407a-463a-828f-17a03710ffe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e91912df342f4226916aeed106f26776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:19Z,use_quota=True,user_id='9b66fe00b8a1422eacca0586216376da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a46deea-2f10-4020-95f3-437a96146b06),volume_type_id=4a46deea-2f10-4020-95f3-437a96146b06)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99aa1d93-7e91-43f5-88a8-b1acbab3aaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99aa1d93-7e91-43f5-88a8-b1acbab3aaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c367ec5-93f0-4e2a-8306-82d1398ecc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:18 devstack cinder-volume[94670]: DEBUG cinder.image.glance [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Creating Keystone auth plugin from conf {{(pid=94670) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 13 09:29:18 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-2a79c8ae-eba7-4351-b2da-ee76c37f2b93 tempest-VolumesGetTest-469370970 None] Created volume successfully. Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c367ec5-93f0-4e2a-8306-82d1398ecc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '789e1754-407a-463a-828f-17a03710ffe2', 'volume_name': 'volume-789e1754-407a-463a-828f-17a03710ffe2', 'volume_size': 1, 'image_id': '521a51a2-0fa5-4dd7-b512-a61ca2552168', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/521a51a2-0fa5-4dd7-b512-a61ca2552168', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--216361786', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e91912df342f4226916aeed106f26776', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '521a51a2-0fa5-4dd7-b512-a61ca2552168', 'created_at': datetime.datetime(2026, 8, 13, 7, 29, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 29, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/521a51a2-0fa5-4dd7-b512-a61ca2552168/file', 'properties': {}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078010f1-84f7-40d4-a683-eee2c8238bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (078010f1-84f7-40d4-a683-eee2c8238bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e4d024-2c59-4b1f-8a7e-8b3af723d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:19 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Volume 789e1754-407a-463a-828f-17a03710ffe2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-789e1754-407a-463a-828f-17a03710ffe2', 'volume_size': 1, 'image_id': '521a51a2-0fa5-4dd7-b512-a61ca2552168', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/521a51a2-0fa5-4dd7-b512-a61ca2552168', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--216361786', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e91912df342f4226916aeed106f26776', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '521a51a2-0fa5-4dd7-b512-a61ca2552168', 'created_at': datetime.datetime(2026, 8, 13, 7, 29, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 29, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/521a51a2-0fa5-4dd7-b512-a61ca2552168/file', 'properties': {}}, 'image_service': } Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Trying to clone 789e1754-407a-463a-828f-17a03710ffe2 from image 521a51a2-0fa5-4dd7-b512-a61ca2552168 at location (None, [{'url': 'file:///opt/stack/data/glance/images/521a51a2-0fa5-4dd7-b512-a61ca2552168', 'metadata': {}}]). {{(pid=94670) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 13 09:29:19 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 1073741824" returned: 0 in 0.747s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:19 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 Aug 13 09:29:19 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:19 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0" returned: 0 in 0.443s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.290s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1873594432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e91912df342f4226916aeed106f26776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:17Z,use_quota=True,user_id='9b66fe00b8a1422eacca0586216376da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a58f3ae-71d7-48d1-8151-bc8b5ba931d9),volume_type_id=6a58f3ae-71d7-48d1-8151-bc8b5ba931d9)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Creating volume 3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:29:19 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:29:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbae07f2-4b57-460f-ad6e-5631f59361aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0e4c72-f315-458b-966c-f83d8d6e11a0', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f8f6e0-da68-4238-838d-6d9f33a86428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:20 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b 1073741824 Aug 13 09:29:20 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:20 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Volume volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 (be0e4c72-f315-458b-966c-f83d8d6e11a0): created successfully Aug 13 09:29:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f8f6e0-da68-4238-838d-6d9f33a86428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Flow 'volume_create_manager' (419dc8e4-e854-43b5-bc2d-dd27bf6f55d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:20 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-9392e00f-f762-495b-91e2-54ebf54be889 tempest-VolumesExtendTest-1132438090 None] Created volume successfully. Aug 13 09:29:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:21 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b 1073741824" returned: 0 in 1.082s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:29:21 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b Aug 13 09:29:21 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Flow 'volume_create_manager' (6e54d24f-4663-4b35-9e04-b17a92f08ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa05c14-5b3f-4217-a6c5-27e5b4b38684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa05c14-5b3f-4217-a6c5-27e5b4b38684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-86099960',display_name='tempest-VolumesGetTest-Volume-671572072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc1efda-0915-4cd5-9d6f-5c14913ea1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9516b5872b0b43e8b9e7a4bd3ccae250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:21Z,use_quota=True,user_id='632ccc0233dd4e459d963d666520f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb37e1e9-ad45-4005-acbc-d56cc7663d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb37e1e9-ad45-4005-acbc-d56cc7663d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926fa44f-60d4-4b24-b509-4ca1d8f993c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926fa44f-60d4-4b24-b509-4ca1d8f993c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcc1efda-0915-4cd5-9d6f-5c14913ea1e5', 'volume_name': 'volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae5c08a-a7ff-4aa4-bf1f-a606d6ee930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae5c08a-a7ff-4aa4-bf1f-a606d6ee930a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1923e2d4-c0bf-4ad0-81d4-ab73d7bd26d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:21 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Volume fcc1efda-0915-4cd5-9d6f-5c14913ea1e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5', 'volume_size': 1} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:21 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b" returned: 0 in 0.352s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.313s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2139086994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee79052-34f2-4d34-ae26-bc7a36ddf162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e91912df342f4226916aeed106f26776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:18Z,use_quota=True,user_id='9b66fe00b8a1422eacca0586216376da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ab3ff00-9811-4967-be2f-dde499057cc0),volume_type_id=6ab3ff00-9811-4967-be2f-dde499057cc0)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Creating volume 7ee79052-34f2-4d34-ae26-bc7a36ddf162 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:29:21 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7588aa18-80e9-4d34-a4ed-bb9d916ec549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77dee213-5421-4469-abb3-cab7a42cd0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:21 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162 1073741824 Aug 13 09:29:21 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:21 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Volume volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b (3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b): created successfully Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77dee213-5421-4469-abb3-cab7a42cd0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Flow 'volume_create_manager' (32125b07-be18-42e9-a673-3efad5146cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:21 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-05039243-57a0-4d21-9fc5-5c4b3b563b0e tempest-TestInstancesWithCinderVolumes-143700902 None] Created volume successfully. Aug 13 09:29:22 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162 1073741824" returned: 0 in 0.842s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:22 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162 Aug 13 09:29:22 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:22 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162" returned: 0 in 0.309s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:29:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.991s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] Creating offline snapshot 7f774725-5473-48e9-a75e-9da77ed40f33 of volume be0e4c72-f315-458b-966c-f83d8d6e11a0 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:29:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d3d6c0-a140-4be8-8578-18e3e832af2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21903c79-728c-494f-bea4-b38bd3fb1684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:22 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf8c84e-e6d7-4bde-8cb9-d364e5921bf3]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:22 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Volume volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162 (7ee79052-34f2-4d34-ae26-bc7a36ddf162): created successfully Aug 13 09:29:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21903c79-728c-494f-bea4-b38bd3fb1684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Flow 'volume_create_manager' (097a9032-2a4b-49c2-937d-dcd5180f8abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:22 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-ae15e163-40ad-49aa-acc3-720a47027bdd tempest-TestInstancesWithCinderVolumes-143700902 None] Created volume successfully. Aug 13 09:29:23 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 Aug 13 09:29:23 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:23 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0" returned: 0 in 0.583s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:23 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 1G Aug 13 09:29:23 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:23 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 1G" returned: 0 in 0.501s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:23 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 Aug 13 09:29:23 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:24 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33" returned: 0 in 0.369s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:24 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 is being set with open permissions: ugo+rw Aug 13 09:29:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:24 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 Aug 13 09:29:24 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:24 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33" returned: 0 in 0.295s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:24 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_521a51a2-0fa5-4dd7-b512-a61ca2552168_u1_ty065devstack@QuobyteHD, size 20.69 MB, duration 5.35 sec {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 13 09:29:24 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Image download 20.69 MB at 3.86 MB/s Aug 13 09:29:24 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.info Aug 13 09:29:24 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:24 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5489aca-226b-4a30-b779-40ea0540eefc]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_521a51a2-0fa5-4dd7-b512-a61ca2552168_u1_ty065devstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:24 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_521a51a2-0fa5-4dd7-b512-a61ca2552168_u1_ty065devstack@QuobyteHD Aug 13 09:29:24 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:24 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.info" returned: 0 in 0.274s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:24 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.info is being set with open permissions: ugo+rw Aug 13 09:29:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:24 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.info Aug 13 09:29:24 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:25 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_521a51a2-0fa5-4dd7-b512-a61ca2552168_u1_ty065devstack@QuobyteHD" returned: 0 in 0.348s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Temporary image 521a51a2-0fa5-4dd7-b512-a61ca2552168 is fetched for user 9b66fe00b8a1422eacca0586216376da. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3cc4b3-d500-4a79-94a1-4a7a55501710]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_521a51a2-0fa5-4dd7-b512-a61ca2552168_u1_ty065devstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:25 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.info" returned: 0 in 0.255s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.450s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.819s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-86099960',display_name='tempest-VolumesGetTest-Volume-671572072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc1efda-0915-4cd5-9d6f-5c14913ea1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9516b5872b0b43e8b9e7a4bd3ccae250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:21Z,use_quota=True,user_id='632ccc0233dd4e459d963d666520f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Creating volume fcc1efda-0915-4cd5-9d6f-5c14913ea1e5 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:29:25 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:25 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5 1073741824 Aug 13 09:29:25 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:25 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-44d00a97-0350-494f-ac9a-042c2c22026a tempest-VolumesExtendTest-1132438090 None] Create snapshot completed successfully Aug 13 09:29:25 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_521a51a2-0fa5-4dd7-b512-a61ca2552168_u1_ty065devstack@QuobyteHD Aug 13 09:29:25 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:25 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_521a51a2-0fa5-4dd7-b512-a61ca2552168_u1_ty065devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:25 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5 1073741824" returned: 0 in 0.525s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:25 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5 Aug 13 09:29:25 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:26 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5" returned: 0 in 0.291s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.555s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1367895756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789e1754-407a-463a-828f-17a03710ffe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e91912df342f4226916aeed106f26776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:19Z,use_quota=True,user_id='9b66fe00b8a1422eacca0586216376da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a46deea-2f10-4020-95f3-437a96146b06),volume_type_id=4a46deea-2f10-4020-95f3-437a96146b06)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Creating volume 789e1754-407a-463a-828f-17a03710ffe2 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:29:26 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-80f03ce0-c892-4653-9660-dd4a593ce58d tempest-VolumesExtendTest-1132438090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:26 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 1073741824 Aug 13 09:29:26 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1923e2d4-c0bf-4ad0-81d4-ab73d7bd26d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c494d179-a4fa-4786-80c0-101f3f88d40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:26 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Volume volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5 (fcc1efda-0915-4cd5-9d6f-5c14913ea1e5): created successfully Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c494d179-a4fa-4786-80c0-101f3f88d40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Flow 'volume_create_manager' (6e54d24f-4663-4b35-9e04-b17a92f08ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-9da4c07b-cc94-4966-a4dd-e448512a820d tempest-VolumesGetTest-469370970 None] Created volume successfully. Aug 13 09:29:26 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 1073741824" returned: 0 in 0.540s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Lock "cinder-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:26 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 Aug 13 09:29:26 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-quobyte-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec1faf0-da7e-4a7f-9ce7-15e9e1fadeb9]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:26 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5 Aug 13 09:29:26 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:26 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2" returned: 0 in 0.302s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-80f03ce0-c892-4653-9660-dd4a593ce58d tempest-VolumesExtendTest-1132438090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.879s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af1ef7b-a614-43d2-8d82-79f9c719fb8b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-80f03ce0-c892-4653-9660-dd4a593ce58d tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Attempting download of 521a51a2-0fa5-4dd7-b512-a61ca2552168 ((None, [{'url': 'file:///opt/stack/data/glance/images/521a51a2-0fa5-4dd7-b512-a61ca2552168', 'metadata': {}}])) to volume 789e1754-407a-463a-828f-17a03710ffe2. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9266cc10-1e74-4978-85d2-46496bdd55ad]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_521a51a2-0fa5-4dd7-b512-a61ca2552168_21mvy05x {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:27 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5" returned: 0 in 0.384s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:27 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 Aug 13 09:29:27 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:27 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5 Aug 13 09:29:27 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:27 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_521a51a2-0fa5-4dd7-b512-a61ca2552168_21mvy05x Aug 13 09:29:27 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:27 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5" returned: 0 in 0.360s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5" released by "delete_volume" :: held 0.791s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:27 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_521a51a2-0fa5-4dd7-b512-a61ca2552168_21mvy05x" returned: 0 in 0.464s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_521a51a2-0fa5-4dd7-b512-a61ca2552168_21mvy05x {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:27 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-80f03ce0-c892-4653-9660-dd4a593ce58d tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0" returned: 0 in 0.577s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-80f03ce0-c892-4653-9660-dd4a593ce58d tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 2G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Created reservations ['8bca33ce-952f-40bd-a0dd-c5aace1bf8c4', '9f6259d9-d581-4175-b0da-15971ea71684', '32c6758f-faa7-445f-9f78-e4bac86da34a', 'dcd54f31-93a5-4080-b09d-d5a6c0fc30a0'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:29:27 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_521a51a2-0fa5-4dd7-b512-a61ca2552168_21mvy05x Aug 13 09:29:27 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-80f03ce0-c892-4653-9660-dd4a593ce58d tempest-VolumesExtendTest-1132438090 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 2G" returned: 0 in 0.172s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-80f03ce0-c892-4653-9660-dd4a593ce58d tempest-VolumesExtendTest-1132438090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.798s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:27 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:29:27 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:27 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-80f03ce0-c892-4653-9660-dd4a593ce58d tempest-VolumesExtendTest-1132438090 None] Extend volume completed successfully. Aug 13 09:29:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-09664425-9771-4fe0-bc5d-a2f30fe8b1ad-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:28 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_521a51a2-0fa5-4dd7-b512-a61ca2552168_21mvy05x" returned: 1 in 0.425s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_521a51a2-0fa5-4dd7-b512-a61ca2552168_21mvy05x' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aea938-4a27-49cd-a290-4a723f064794]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_521a51a2-0fa5-4dd7-b512-a61ca2552168_u1_ty065devstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Lock "cinder-09664425-9771-4fe0-bc5d-a2f30fe8b1ad-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-quobyte-09664425-9771-4fe0-bc5d-a2f30fe8b1ad" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-09664425-9771-4fe0-bc5d-a2f30fe8b1ad" acquired by "delete_volume" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e915171d-bcf1-49c8-9e26-fd3c69394a2c]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:28 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.371s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:29:28 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Deleted volume successfully. Aug 13 09:29:28 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_521a51a2-0fa5-4dd7-b512-a61ca2552168_u1_ty065devstack@QuobyteHD Aug 13 09:29:28 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6a4d8ba0-c7c8-4cf7-8abf-16b2d736d1a7 tempest-VolumesGetTest-469370970 None] Lock "cinder-fcc1efda-0915-4cd5-9d6f-5c14913ea1e5-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:28 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad Aug 13 09:29:28 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Acquiring lock "cinder-7f774725-5473-48e9-a75e-9da77ed40f33-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Lock "cinder-7f774725-5473-48e9-a75e-9da77ed40f33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Acquiring lock "cinder-quobyte-be0e4c72-f315-458b-966c-f83d8d6e11a0" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:28 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_521a51a2-0fa5-4dd7-b512-a61ca2552168_u1_ty065devstack@QuobyteHD" returned: 0 in 0.540s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] 521a51a2-0fa5-4dd7-b512-a61ca2552168 was qcow2, converting to raw {{(pid=94670) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_521a51a2-0fa5-4dd7-b512-a61ca2552168_u1_ty065devstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Lock "cinder-quobyte-be0e4c72-f315-458b-966c-f83d8d6e11a0" acquired by "delete_snapshot" :: waited 0.053s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:28 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_521a51a2-0fa5-4dd7-b512-a61ca2552168_u1_ty065devstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Acquiring lock "cinder-quobyte-7f774725-5473-48e9-a75e-9da77ed40f33" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:28 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Lock "cinder-quobyte-7f774725-5473-48e9-a75e-9da77ed40f33" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Deleting offline snapshot 7f774725-5473-48e9-a75e-9da77ed40f33 of volume be0e4c72-f315-458b-966c-f83d8d6e11a0 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] snapshot_file for this snap is: volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:29:28 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad" returned: 0 in 0.522s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b16554b-1873-4ee5-abfe-453bb1e873be]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:28 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad Aug 13 09:29:28 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:28 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 Aug 13 09:29:28 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:28 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-09664425-9771-4fe0-bc5d-a2f30fe8b1ad" returned: 0 in 0.282s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-09664425-9771-4fe0-bc5d-a2f30fe8b1ad" released by "delete_volume" :: held 0.856s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Created reservations ['6fb3f96b-025b-40db-b307-0bace70f253a', '9c226a11-ceac-43e5-9958-8fafa8414973', '54b2ab48-3c4c-4eb1-bba9-23ec38b814b6', '0e1655b0-0799-4ec6-9443-330586dcb88d'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:29 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:29:29 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:29 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33" returned: 0 in 0.534s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be0e4c72-f315-458b-966c-f83d8d6e11a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6fd00e-8fa5-4fc9-9f44-1665fea13965]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-cd33cc9f-9e87-4111-b42f-b5138db5ff99-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Lock "cinder-cd33cc9f-9e87-4111-b42f-b5138db5ff99-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:29 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 Aug 13 09:29:29 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-quobyte-cd33cc9f-9e87-4111-b42f-b5138db5ff99" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-cd33cc9f-9e87-4111-b42f-b5138db5ff99" acquired by "delete_volume" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb3d8ac-8ff8-41b1-ab57-680577873970]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:29 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.576s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:29:29 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Deleted volume successfully. Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9b7066a1-0958-4b04-982d-b12132d59cad tempest-VolumesGetTest-469370970 None] Lock "cinder-09664425-9771-4fe0-bc5d-a2f30fe8b1ad-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:29 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 Aug 13 09:29:29 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:29 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0" returned: 0 in 0.580s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:29 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 Aug 13 09:29:29 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:30 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99" returned: 0 in 0.501s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:30 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99 Aug 13 09:29:30 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:30 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33" returned: 0 in 0.534s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:30 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33 Aug 13 09:29:30 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:30 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cd33cc9f-9e87-4111-b42f-b5138db5ff99" returned: 0 in 0.361s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-cd33cc9f-9e87-4111-b42f-b5138db5ff99" released by "delete_volume" :: held 0.973s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Created reservations ['859a0c36-97a6-4651-b7f3-0b0b98a306fa', '363a028b-ea84-4435-90bf-a5de0c849937', '96c78794-6466-4e65-980c-7dd468d27c1c', '154e2336-0de2-4f74-a5c7-183e7c0c1eec'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:30 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_521a51a2-0fa5-4dd7-b512-a61ca2552168_u1_ty065devstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2" returned: 0 in 2.128s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_521a51a2-0fa5-4dd7-b512-a61ca2552168_u1_ty065devstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:29:30 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Converted 112.00 MB image at 52.57 MB/s Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:30 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:29:30 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:30 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 1G Aug 13 09:29:30 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:30 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0.7f774725-5473-48e9-a75e-9da77ed40f33" returned: 0 in 0.390s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Lock "cinder-quobyte-7f774725-5473-48e9-a75e-9da77ed40f33" released by "_delete_snapshot" :: held 2.192s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Lock "cinder-quobyte-be0e4c72-f315-458b-966c-f83d8d6e11a0" released by "delete_snapshot" :: held 2.237s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:30 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Created reservations ['c1a689dc-e02d-4dad-9203-b239e8b4a7c4', 'f53f66db-6899-4a10-b266-d175af85c83d', 'da01565b-a369-4f18-a37b-c98c4b78715a', 'f0ebd6dd-0183-458c-a97a-668d5b017465'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:29:31 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Delete snapshot completed successfully. Aug 13 09:29:31 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.326s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e23968b4-b6ca-452c-978d-bc11970395c4 tempest-VolumesExtendTest-1132438090 None] Lock "cinder-7f774725-5473-48e9-a75e-9da77ed40f33-delete_snapshot" released by "delete_snapshot" :: held 2.458s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:31 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Deleted volume successfully. Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-55189db5-76cd-4e5d-8cb8-e665601bb106 tempest-VolumesGetTest-469370970 None] Lock "cinder-cd33cc9f-9e87-4111-b42f-b5138db5ff99-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:31 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 1G" returned: 0 in 0.360s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da7e5df-6800-45ed-93e3-8a0ae5722f82]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:31 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 Aug 13 09:29:31 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:31 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2" returned: 0 in 0.368s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:31 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 Aug 13 09:29:31 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:31 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2" returned: 1 in 0.415s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Downloaded image 521a51a2-0fa5-4dd7-b512-a61ca2552168 ((None, [{'url': 'file:///opt/stack/data/glance/images/521a51a2-0fa5-4dd7-b512-a61ca2552168', 'metadata': {}}])) to volume 789e1754-407a-463a-828f-17a03710ffe2 successfully. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Temporary image 521a51a2-0fa5-4dd7-b512-a61ca2552168 for user 9b66fe00b8a1422eacca0586216376da is deleted. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Marking volume 789e1754-407a-463a-828f-17a03710ffe2 as bootable. {{(pid=94670) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Copying metadata from image 521a51a2-0fa5-4dd7-b512-a61ca2552168 to 789e1754-407a-463a-828f-17a03710ffe2. {{(pid=94670) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Creating volume glance metadata for volume 789e1754-407a-463a-828f-17a03710ffe2 backed by image 521a51a2-0fa5-4dd7-b512-a61ca2552168 with: {'image_id': '521a51a2-0fa5-4dd7-b512-a61ca2552168', 'image_name': 'tempest-scenario-img--216361786', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94670) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Acquiring lock "cinder-be0e4c72-f315-458b-966c-f83d8d6e11a0-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Lock "cinder-be0e4c72-f315-458b-966c-f83d8d6e11a0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e4d024-2c59-4b1f-8a7e-8b3af723d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-789e1754-407a-463a-828f-17a03710ffe2', 'volume_size': 1, 'image_id': '521a51a2-0fa5-4dd7-b512-a61ca2552168', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/521a51a2-0fa5-4dd7-b512-a61ca2552168', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--216361786', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e91912df342f4226916aeed106f26776', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '521a51a2-0fa5-4dd7-b512-a61ca2552168', 'created_at': datetime.datetime(2026, 8, 13, 7, 29, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 29, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/521a51a2-0fa5-4dd7-b512-a61ca2552168/file', 'properties': {}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c305c107-212b-4e06-923d-ab45e678aa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Acquiring lock "cinder-quobyte-be0e4c72-f315-458b-966c-f83d8d6e11a0" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:32 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Volume volume-789e1754-407a-463a-828f-17a03710ffe2 (789e1754-407a-463a-828f-17a03710ffe2): created successfully Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c305c107-212b-4e06-923d-ab45e678aa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Flow 'volume_create_manager' (68597b5c-b54d-4284-999f-62395651780f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Lock "cinder-quobyte-be0e4c72-f315-458b-966c-f83d8d6e11a0" acquired by "delete_volume" :: waited 0.027s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ed373c-7bdb-42c6-bf35-9b323e06f069]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:32 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-15981312-10b6-4310-9b46-68a70dd99fa2 tempest-TestInstancesWithCinderVolumes-143700902 None] Created volume successfully. Aug 13 09:29:32 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 Aug 13 09:29:32 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:32 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0" returned: 0 in 0.397s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:32 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0 Aug 13 09:29:32 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Flow 'volume_create_manager' (d08aa052-1fd7-4f32-832f-6b90a548597f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a47e69-f6eb-4407-930d-10f2ce550fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a47e69-f6eb-4407-930d-10f2ce550fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1859934623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9516b5872b0b43e8b9e7a4bd3ccae250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:33Z,use_quota=True,user_id='632ccc0233dd4e459d963d666520f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb3a3a1-993b-49ad-88df-d07858787fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb3a3a1-993b-49ad-88df-d07858787fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dcb4dd-512f-4352-b665-85ab8edb1fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.image.glance [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Creating Keystone auth plugin from conf {{(pid=94670) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 13 09:29:32 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be0e4c72-f315-458b-966c-f83d8d6e11a0" returned: 0 in 0.254s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Lock "cinder-quobyte-be0e4c72-f315-458b-966c-f83d8d6e11a0" released by "delete_volume" :: held 0.715s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Created reservations ['462cfb7f-4a96-4ca1-80ff-8e6877f2265c', '581b8de4-f2d0-48e1-85ec-7506e5214027', '7b99842e-138f-47e9-86d0-bd5ead3ea172', 'f5bc9f56-a980-40ae-bfa6-c2161f0f04e4'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:32 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:29:32 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dcb4dd-512f-4352-b665-85ab8edb1fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45', 'volume_name': 'volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45', 'volume_size': 1, 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3c2349994ac4b0198f93975c909efdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'created_at': datetime.datetime(2026, 8, 13, 7, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 15, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1330bb5-9d27-4913-888d-485e4ed28bd9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96fdf12-a2ba-4373-b57b-bd5c561db000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96fdf12-a2ba-4373-b57b-bd5c561db000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804130ad-aeab-40c2-ac62-a87be336e009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:33 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Volume 1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45', 'volume_size': 1, 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3c2349994ac4b0198f93975c909efdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'created_at': datetime.datetime(2026, 8, 13, 7, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 15, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1330bb5-9d27-4913-888d-485e4ed28bd9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 13 09:29:33 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Trying to clone 1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 from image b1330bb5-9d27-4913-888d-485e4ed28bd9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]). {{(pid=94670) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 13 09:29:33 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.314s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:33 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:29:33 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Deleted volume successfully. Aug 13 09:29:33 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-76ea54dc-5b53-4de2-a161-208604282da0 tempest-VolumesExtendTest-1132438090 None] Lock "cinder-be0e4c72-f315-458b-966c-f83d8d6e11a0-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:33 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_i10pzhu1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 13 09:29:33 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Image download 20.69 MB at 20.69 MB/s Aug 13 09:29:33 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cf3277-e12b-4f6b-971e-c29072e0dc63]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_i10pzhu1devstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:33 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_i10pzhu1devstack@QuobyteHD Aug 13 09:29:33 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:33 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_i10pzhu1devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:33 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Temporary image b1330bb5-9d27-4913-888d-485e4ed28bd9 is fetched for user 632ccc0233dd4e459d963d666520f55c. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 13 09:29:33 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[854e933f-2efd-4604-a982-85342aae331d]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_i10pzhu1devstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:34 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_i10pzhu1devstack@QuobyteHD Aug 13 09:29:34 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:34 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_i10pzhu1devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1859934623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9516b5872b0b43e8b9e7a4bd3ccae250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:33Z,use_quota=True,user_id='632ccc0233dd4e459d963d666520f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:29:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Creating volume 1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:29:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:29:34 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:29:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:34 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 1073741824 Aug 13 09:29:34 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:34 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 1073741824" returned: 0 in 0.579s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:35 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 Aug 13 09:29:35 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:35 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45" returned: 0 in 0.308s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:29:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:35 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Attempting download of b1330bb5-9d27-4913-888d-485e4ed28bd9 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}])) to volume 1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 13 09:29:35 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf50c80-ecf4-47e9-bdab-72022a00b325]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_maea1ihc {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:35 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_maea1ihc Aug 13 09:29:35 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:35 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_maea1ihc" returned: 0 in 0.435s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_maea1ihc {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-4dafbe19-51c2-41e5-a5bd-ae2e01590265 req-093eced1-bea4-4971-b48a-e86b8e1738c5 tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-4dafbe19-51c2-41e5-a5bd-ae2e01590265 req-093eced1-bea4-4971-b48a-e86b8e1738c5 tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:36 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7888fe41-dd8f-41fb-b13b-a555998756f8]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-4dafbe19-51c2-41e5-a5bd-ae2e01590265 req-093eced1-bea4-4971-b48a-e86b8e1738c5 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:36 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_maea1ihc Aug 13 09:29:36 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:36 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 Aug 13 09:29:36 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:36 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_maea1ihc" returned: 1 in 0.413s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_maea1ihc' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:29:36 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2f321f-cc29-45e8-b83a-0b961e4f3177]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_i10pzhu1devstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:36 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_i10pzhu1devstack@QuobyteHD Aug 13 09:29:36 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:36 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-4dafbe19-51c2-41e5-a5bd-ae2e01590265 req-093eced1-bea4-4971-b48a-e86b8e1738c5 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2" returned: 0 in 0.749s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-4dafbe19-51c2-41e5-a5bd-ae2e01590265 req-093eced1-bea4-4971-b48a-e86b8e1738c5 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:36 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_i10pzhu1devstack@QuobyteHD" returned: 0 in 0.590s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:36 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] b1330bb5-9d27-4913-888d-485e4ed28bd9 was qcow2, converting to raw {{(pid=94670) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 13 09:29:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_i10pzhu1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:36 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_i10pzhu1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 Aug 13 09:29:36 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:37 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 Aug 13 09:29:37 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Flow 'volume_create_manager' (bee2c0f5-7fb9-4c32-9412-dd5edad06f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15530420-4a19-4b13-9622-42656e8c9684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15530420-4a19-4b13-9622-42656e8c9684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1368566676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a0812e-e43c-48ae-91e9-9644fb9d404e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6072a55508644bf8f617e548373c9b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:37Z,use_quota=True,user_id='524ac2f35f584dc4a2484f778bc18fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec709b1-3f0f-45d2-bdf3-108ebff76ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec709b1-3f0f-45d2-bdf3-108ebff76ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80fd2b6-fc62-46d0-8cd3-bce8be3a9aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80fd2b6-fc62-46d0-8cd3-bce8be3a9aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60a0812e-e43c-48ae-91e9-9644fb9d404e', 'volume_name': 'volume-60a0812e-e43c-48ae-91e9-9644fb9d404e', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639c46fb-fb87-4d93-a7e7-b5d5f9e69f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639c46fb-fb87-4d93-a7e7-b5d5f9e69f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2736ad0a-c00b-4992-856b-aa8ada7658b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:37 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Volume 60a0812e-e43c-48ae-91e9-9644fb9d404e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60a0812e-e43c-48ae-91e9-9644fb9d404e', 'volume_size': 1} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:37 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-4dafbe19-51c2-41e5-a5bd-ae2e01590265 req-093eced1-bea4-4971-b48a-e86b8e1738c5 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2" returned: 1 in 0.586s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-4dafbe19-51c2-41e5-a5bd-ae2e01590265 req-093eced1-bea4-4971-b48a-e86b8e1738c5 tempest-TestInstancesWithCinderVolumes-143700902 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-4dafbe19-51c2-41e5-a5bd-ae2e01590265 req-093eced1-bea4-4971-b48a-e86b8e1738c5 tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.393s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.183s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1368566676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a0812e-e43c-48ae-91e9-9644fb9d404e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6072a55508644bf8f617e548373c9b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:37Z,use_quota=True,user_id='524ac2f35f584dc4a2484f778bc18fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Creating volume 60a0812e-e43c-48ae-91e9-9644fb9d404e {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:29:37 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-60a0812e-e43c-48ae-91e9-9644fb9d404e 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:37 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-60a0812e-e43c-48ae-91e9-9644fb9d404e 1073741824 Aug 13 09:29:37 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-4dafbe19-51c2-41e5-a5bd-ae2e01590265 req-093eced1-bea4-4971-b48a-e86b8e1738c5 tempest-TestInstancesWithCinderVolumes-143700902 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-789e1754-407a-463a-828f-17a03710ffe2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7622e76b-bf62-4529-bfaf-e49bfb524702', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:29:37 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-4dafbe19-51c2-41e5-a5bd-ae2e01590265 req-093eced1-bea4-4971-b48a-e86b8e1738c5 tempest-TestInstancesWithCinderVolumes-143700902 None] attachment_update completed successfully. Aug 13 09:29:38 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-60a0812e-e43c-48ae-91e9-9644fb9d404e 1073741824" returned: 0 in 0.773s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-60a0812e-e43c-48ae-91e9-9644fb9d404e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:38 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-60a0812e-e43c-48ae-91e9-9644fb9d404e Aug 13 09:29:38 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:38 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-60a0812e-e43c-48ae-91e9-9644fb9d404e" returned: 0 in 0.324s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:29:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2736ad0a-c00b-4992-856b-aa8ada7658b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a0812e-e43c-48ae-91e9-9644fb9d404e', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04109c96-4fe7-4b22-a2e6-75c654bc496a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:38 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Volume volume-60a0812e-e43c-48ae-91e9-9644fb9d404e (60a0812e-e43c-48ae-91e9-9644fb9d404e): created successfully Aug 13 09:29:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04109c96-4fe7-4b22-a2e6-75c654bc496a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Flow 'volume_create_manager' (bee2c0f5-7fb9-4c32-9412-dd5edad06f20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:38 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e041c265-ea50-43d5-8c72-d29200de5c05 tempest-VolumesNegativeTest-171346491 None] Created volume successfully. Aug 13 09:29:39 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_i10pzhu1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45" returned: 0 in 2.373s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:39 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_i10pzhu1devstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:29:39 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Converted 112.00 MB image at 47.15 MB/s Aug 13 09:29:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:39 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 1G Aug 13 09:29:39 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:39 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 1G" returned: 0 in 0.505s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:39 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a56b4c-2461-4f7a-80fe-131a8295b601]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:40 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 Aug 13 09:29:40 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:40 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45" returned: 0 in 0.727s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:40 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 Aug 13 09:29:40 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:41 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45" returned: 1 in 0.463s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:29:41 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Downloaded image b1330bb5-9d27-4913-888d-485e4ed28bd9 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}])) to volume 1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 successfully. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 13 09:29:41 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Temporary image b1330bb5-9d27-4913-888d-485e4ed28bd9 for user 632ccc0233dd4e459d963d666520f55c is deleted. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 13 09:29:41 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Marking volume 1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 as bootable. {{(pid=94670) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 13 09:29:41 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Copying metadata from image b1330bb5-9d27-4913-888d-485e4ed28bd9 to 1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45. {{(pid=94670) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 13 09:29:41 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Creating volume glance metadata for volume 1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 backed by image b1330bb5-9d27-4913-888d-485e4ed28bd9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94670) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 13 09:29:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804130ad-aeab-40c2-ac62-a87be336e009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45', 'volume_size': 1, 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3c2349994ac4b0198f93975c909efdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'created_at': datetime.datetime(2026, 8, 13, 7, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 15, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1330bb5-9d27-4913-888d-485e4ed28bd9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91300b82-c973-4971-af8d-6c0759e3ddf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:41 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Volume volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 (1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45): created successfully Aug 13 09:29:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91300b82-c973-4971-af8d-6c0759e3ddf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Flow 'volume_create_manager' (d08aa052-1fd7-4f32-832f-6b90a548597f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:41 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c22a2919-1f32-4450-a470-76cd988153d5 tempest-VolumesGetTest-469370970 None] Created volume successfully. Aug 13 09:29:42 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:29:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Flow 'volume_create_manager' (8e445c43-c7f6-4d38-b9e1-111668074f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4fd73e-ce0d-4087-91ab-5197bd827cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4fd73e-ce0d-4087-91ab-5197bd827cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-788174235',display_name='tempest-VolumesGetTest-Volume-1283137324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166095bb-178b-4541-9ccb-26bd3205a8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9516b5872b0b43e8b9e7a4bd3ccae250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:43Z,use_quota=True,user_id='632ccc0233dd4e459d963d666520f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c88f122-32d3-404c-9c53-2d5009120af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c88f122-32d3-404c-9c53-2d5009120af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05eb8e18-8c65-4186-8b64-189b3f890826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05eb8e18-8c65-4186-8b64-189b3f890826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '166095bb-178b-4541-9ccb-26bd3205a8fd', 'volume_name': 'volume-166095bb-178b-4541-9ccb-26bd3205a8fd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858db4ba-f2d1-4803-ba81-db9e381578f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858db4ba-f2d1-4803-ba81-db9e381578f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5857c5fa-8107-4f89-88c3-3712b9382428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:43 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Volume 166095bb-178b-4541-9ccb-26bd3205a8fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-166095bb-178b-4541-9ccb-26bd3205a8fd', 'volume_size': 1} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-788174235',display_name='tempest-VolumesGetTest-Volume-1283137324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166095bb-178b-4541-9ccb-26bd3205a8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9516b5872b0b43e8b9e7a4bd3ccae250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:43Z,use_quota=True,user_id='632ccc0233dd4e459d963d666520f55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Creating volume 166095bb-178b-4541-9ccb-26bd3205a8fd {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:29:43 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-166095bb-178b-4541-9ccb-26bd3205a8fd 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:43 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-166095bb-178b-4541-9ccb-26bd3205a8fd 1073741824 Aug 13 09:29:43 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:43 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:29:43 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:43 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.586s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:29:43 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-166095bb-178b-4541-9ccb-26bd3205a8fd 1073741824" returned: 0 in 0.867s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-166095bb-178b-4541-9ccb-26bd3205a8fd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:44 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-166095bb-178b-4541-9ccb-26bd3205a8fd Aug 13 09:29:44 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Flow 'volume_create_manager' (273ab9da-4c87-4dbd-a4b6-3f9e8f752ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad4ab494-a46f-422b-a5f4-8ab1569dc8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad4ab494-a46f-422b-a5f4-8ab1569dc8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1450456598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e7298f9-246f-43fb-a2eb-371799068b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87add6622ea430ea7954ec9756993dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:44Z,use_quota=True,user_id='a38f1dfac54e4411a17ec5b029e6ef20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf09eddd-8753-4eab-b285-8c0db57d64fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf09eddd-8753-4eab-b285-8c0db57d64fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d09ee0-1108-4294-87c5-1b758f684ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d09ee0-1108-4294-87c5-1b758f684ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e7298f9-246f-43fb-a2eb-371799068b63', 'volume_name': 'volume-8e7298f9-246f-43fb-a2eb-371799068b63', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ffe066-5320-41a2-9429-8ae31ece08e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ffe066-5320-41a2-9429-8ae31ece08e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c78b0b-e252-47d9-85a0-d03badf6e145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:44 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Volume 8e7298f9-246f-43fb-a2eb-371799068b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e7298f9-246f-43fb-a2eb-371799068b63', 'volume_size': 1} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:44 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-166095bb-178b-4541-9ccb-26bd3205a8fd" returned: 0 in 0.622s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.320s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1450456598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e7298f9-246f-43fb-a2eb-371799068b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87add6622ea430ea7954ec9756993dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:29:44Z,use_quota=True,user_id='a38f1dfac54e4411a17ec5b029e6ef20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Creating volume 8e7298f9-246f-43fb-a2eb-371799068b63 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:29:44 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8e7298f9-246f-43fb-a2eb-371799068b63 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5857c5fa-8107-4f89-88c3-3712b9382428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-166095bb-178b-4541-9ccb-26bd3205a8fd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38be6888-d986-4f55-a83d-8f679905b9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:44 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8e7298f9-246f-43fb-a2eb-371799068b63 1073741824 Aug 13 09:29:44 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Volume volume-166095bb-178b-4541-9ccb-26bd3205a8fd (166095bb-178b-4541-9ccb-26bd3205a8fd): created successfully Aug 13 09:29:44 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38be6888-d986-4f55-a83d-8f679905b9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Flow 'volume_create_manager' (8e445c43-c7f6-4d38-b9e1-111668074f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:44 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-083af35f-aad0-4ce1-b43c-77225de61e1d tempest-VolumesGetTest-469370970 None] Created volume successfully. Aug 13 09:29:45 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8e7298f9-246f-43fb-a2eb-371799068b63 1073741824" returned: 0 in 0.682s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8e7298f9-246f-43fb-a2eb-371799068b63 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:45 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8e7298f9-246f-43fb-a2eb-371799068b63 Aug 13 09:29:45 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:45 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8e7298f9-246f-43fb-a2eb-371799068b63" returned: 0 in 0.373s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:29:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c78b0b-e252-47d9-85a0-d03badf6e145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e7298f9-246f-43fb-a2eb-371799068b63', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df717a9-8433-45ca-aaeb-44e12dc2cced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:29:45 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Volume volume-8e7298f9-246f-43fb-a2eb-371799068b63 (8e7298f9-246f-43fb-a2eb-371799068b63): created successfully Aug 13 09:29:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df717a9-8433-45ca-aaeb-44e12dc2cced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:29:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Flow 'volume_create_manager' (273ab9da-4c87-4dbd-a4b6-3f9e8f752ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:29:45 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6a303ba7-a17a-4ffd-9e89-078cbfdeba2d tempest-AttachVolumeNegativeTest-1910161388 None] Created volume successfully. Aug 13 09:29:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-166095bb-178b-4541-9ccb-26bd3205a8fd-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Lock "cinder-166095bb-178b-4541-9ccb-26bd3205a8fd-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-quobyte-166095bb-178b-4541-9ccb-26bd3205a8fd" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-166095bb-178b-4541-9ccb-26bd3205a8fd" acquired by "delete_volume" :: waited 0.029s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:46 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc245fc-20c9-4dd8-8716-5773eccd4476]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-166095bb-178b-4541-9ccb-26bd3205a8fd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:46 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-166095bb-178b-4541-9ccb-26bd3205a8fd Aug 13 09:29:46 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:47 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-166095bb-178b-4541-9ccb-26bd3205a8fd" returned: 0 in 0.544s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-166095bb-178b-4541-9ccb-26bd3205a8fd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:47 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-166095bb-178b-4541-9ccb-26bd3205a8fd Aug 13 09:29:47 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:47 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-166095bb-178b-4541-9ccb-26bd3205a8fd" returned: 0 in 0.470s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-166095bb-178b-4541-9ccb-26bd3205a8fd" released by "delete_volume" :: held 1.091s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:47 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Created reservations ['cbed6520-2401-4d0e-8f6e-afdf33dcd3cf', '19ffe36c-c3c9-4b42-9865-27cb90ffc83c', '4dd1a64b-2168-451c-9094-8525b21e2547', '14edd0d1-ec2d-4b85-bddf-6bad877076c2'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:29:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:47 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:29:47 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-7dd07e0d-4c1d-4491-adc5-bc602b70326f req-9b7c004a-ea88-45fa-982f-bc1e437c8750 tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-7dd07e0d-4c1d-4491-adc5-bc602b70326f req-9b7c004a-ea88-45fa-982f-bc1e437c8750 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:48 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.432s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:48 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:29:48 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad0859a-38db-4031-90ce-be8874bf247c]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-7dd07e0d-4c1d-4491-adc5-bc602b70326f req-9b7c004a-ea88-45fa-982f-bc1e437c8750 tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8e7298f9-246f-43fb-a2eb-371799068b63 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:48 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Deleted volume successfully. Aug 13 09:29:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8afe2499-9dd3-4624-9d4b-f0931ba736c9 tempest-VolumesGetTest-469370970 None] Lock "cinder-166095bb-178b-4541-9ccb-26bd3205a8fd-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:48 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8e7298f9-246f-43fb-a2eb-371799068b63 Aug 13 09:29:48 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:49 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-7dd07e0d-4c1d-4491-adc5-bc602b70326f req-9b7c004a-ea88-45fa-982f-bc1e437c8750 tempest-AttachVolumeNegativeTest-1910161388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8e7298f9-246f-43fb-a2eb-371799068b63" returned: 0 in 0.761s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-7dd07e0d-4c1d-4491-adc5-bc602b70326f req-9b7c004a-ea88-45fa-982f-bc1e437c8750 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.813s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Lock "cinder-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-7dd07e0d-4c1d-4491-adc5-bc602b70326f req-9b7c004a-ea88-45fa-982f-bc1e437c8750 tempest-AttachVolumeNegativeTest-1910161388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-8e7298f9-246f-43fb-a2eb-371799068b63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f9181f3-251a-4da7-b5d4-d61886f4aabc', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:29:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Acquiring lock "cinder-quobyte-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:29:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45" acquired by "delete_volume" :: waited 0.041s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:29:49 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-7dd07e0d-4c1d-4491-adc5-bc602b70326f req-9b7c004a-ea88-45fa-982f-bc1e437c8750 tempest-AttachVolumeNegativeTest-1910161388 None] attachment_update completed successfully. Aug 13 09:29:49 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d98838-04d1-40f0-b4ce-59b089ecc2bd]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:29:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:49 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 Aug 13 09:29:49 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:50 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45" returned: 0 in 0.920s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:50 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 Aug 13 09:29:50 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:51 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45" returned: 1 in 1.154s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:29:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:51 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45 Aug 13 09:29:51 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:52 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45" returned: 0 in 0.713s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:52 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Lock "cinder-quobyte-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45" released by "delete_volume" :: held 3.007s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:29:52 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Created reservations ['fdc13fcb-99dd-4c7c-b7d9-c3856ae987ab', '8e4e8131-47ae-45d5-af7f-b121b2870397', 'fd43da50-67fa-44be-b195-09c28696a6e8', '57e1187a-b002-4ec3-a409-93e4d0aedcf2'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:29:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:29:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:29:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:29:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:29:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:29:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:29:52 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:29:52 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:29:53 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Aug 13 09:29:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.516s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:29:53 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:29:53 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Deleted volume successfully. Aug 13 09:29:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-367a390c-2bcf-4177-b549-77a7da158e64 tempest-VolumesGetTest-469370970 None] Lock "cinder-1f0bcd2f-17c6-4d96-9b5b-2548bc3d6d45-delete_volume" released by "delete_volume" :: held 4.183s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:30:02 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=89,cinder:SELECT=92,cinder:INSERT=37,cinder:DELETE=9 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:30:03 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=97,cinder:SELECT=72,cinder:DELETE=8,cinder:INSERT=24 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:30:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-49b662fa-276f-419f-a358-52121a1851e8 req-08e3d4a7-09cb-4b9e-8211-32877b108b9c tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-49b662fa-276f-419f-a358-52121a1851e8 req-08e3d4a7-09cb-4b9e-8211-32877b108b9c tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:13 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7202a58-d574-42a0-b917-a848e6f6173d]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:30:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-49b662fa-276f-419f-a358-52121a1851e8 req-08e3d4a7-09cb-4b9e-8211-32877b108b9c tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:14 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b Aug 13 09:30:14 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:14 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-49b662fa-276f-419f-a358-52121a1851e8 req-08e3d4a7-09cb-4b9e-8211-32877b108b9c tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b" returned: 0 in 0.654s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-49b662fa-276f-419f-a358-52121a1851e8 req-08e3d4a7-09cb-4b9e-8211-32877b108b9c tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.688s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-49b662fa-276f-419f-a358-52121a1851e8 req-08e3d4a7-09cb-4b9e-8211-32877b108b9c tempest-TestInstancesWithCinderVolumes-143700902 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2522b6da-91bf-4976-aa7c-c05652ce56de', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:30:14 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-49b662fa-276f-419f-a358-52121a1851e8 req-08e3d4a7-09cb-4b9e-8211-32877b108b9c tempest-TestInstancesWithCinderVolumes-143700902 None] attachment_update completed successfully. Aug 13 09:30:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Acquiring lock "cinder-60a0812e-e43c-48ae-91e9-9644fb9d404e-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:30:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Lock "cinder-60a0812e-e43c-48ae-91e9-9644fb9d404e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:30:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Acquiring lock "cinder-quobyte-60a0812e-e43c-48ae-91e9-9644fb9d404e" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:30:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Lock "cinder-quobyte-60a0812e-e43c-48ae-91e9-9644fb9d404e" acquired by "delete_volume" :: waited 0.020s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:30:15 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5df9955-52a4-4fe0-8c48-c84cc41d7008]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:30:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-60a0812e-e43c-48ae-91e9-9644fb9d404e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:15 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-60a0812e-e43c-48ae-91e9-9644fb9d404e Aug 13 09:30:15 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:16 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-60a0812e-e43c-48ae-91e9-9644fb9d404e" returned: 0 in 0.733s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-60a0812e-e43c-48ae-91e9-9644fb9d404e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:16 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-60a0812e-e43c-48ae-91e9-9644fb9d404e Aug 13 09:30:16 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:16 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-60a0812e-e43c-48ae-91e9-9644fb9d404e" returned: 0 in 0.648s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Lock "cinder-quobyte-60a0812e-e43c-48ae-91e9-9644fb9d404e" released by "delete_volume" :: held 1.449s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:30:16 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Created reservations ['98684962-372a-4796-9ade-8758d7a589f7', '48a02af2-f097-4834-800a-584b5f87acdb', '87690daa-15d4-4830-b4f7-1204dd26ec84', '0154dd48-3e2a-4b18-aa48-ea0b709a8611'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:30:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:30:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:30:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:17 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:30:17 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:17 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.587s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:17 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:30:17 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Deleted volume successfully. Aug 13 09:30:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f9ca296c-2d82-417f-afd5-54fa645660dd tempest-VolumesNegativeTest-171346491 None] Lock "cinder-60a0812e-e43c-48ae-91e9-9644fb9d404e-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:30:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-fbb9eaa4-4217-4231-8c05-607afa33a0ed req-0107f2af-edfb-4c49-b1ab-85bd961372c2 tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-fbb9eaa4-4217-4231-8c05-607afa33a0ed req-0107f2af-edfb-4c49-b1ab-85bd961372c2 tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:19 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7d49fa-fb00-41e3-93cb-542b2212b37d]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:30:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-fbb9eaa4-4217-4231-8c05-607afa33a0ed req-0107f2af-edfb-4c49-b1ab-85bd961372c2 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:19 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162 Aug 13 09:30:19 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:19 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-fbb9eaa4-4217-4231-8c05-607afa33a0ed req-0107f2af-edfb-4c49-b1ab-85bd961372c2 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162" returned: 0 in 0.511s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-fbb9eaa4-4217-4231-8c05-607afa33a0ed req-0107f2af-edfb-4c49-b1ab-85bd961372c2 tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.546s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-fbb9eaa4-4217-4231-8c05-607afa33a0ed req-0107f2af-edfb-4c49-b1ab-85bd961372c2 tempest-TestInstancesWithCinderVolumes-143700902 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'daf3b102-1f0b-4fbd-970f-2679d022186c', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:30:20 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-fbb9eaa4-4217-4231-8c05-607afa33a0ed req-0107f2af-edfb-4c49-b1ab-85bd961372c2 tempest-TestInstancesWithCinderVolumes-143700902 None] attachment_update completed successfully. Aug 13 09:30:27 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-f4973ebc-be7c-4f81-8c97-fba38d4b79b4 req-bc5b6bd0-51e4-4b9c-ab66-85d641de8d15 tempest-TestInstancesWithCinderVolumes-143700902 None] Terminate volume connection completed successfully. Aug 13 09:30:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-f4973ebc-be7c-4f81-8c97-fba38d4b79b4 req-bc5b6bd0-51e4-4b9c-ab66-85d641de8d15 tempest-TestInstancesWithCinderVolumes-143700902 None] Deleting attachment 2522b6da-91bf-4976-aa7c-c05652ce56de. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:30:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "cinder-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:30:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "cinder-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:30:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "cinder-quobyte-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:30:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "cinder-quobyte-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:30:28 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52bce39-3385-45d0-92cf-3a00148b7069]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:30:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:28 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b Aug 13 09:30:28 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:28 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b" returned: 0 in 0.485s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:29 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b Aug 13 09:30:29 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:29 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b" returned: 0 in 0.274s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "cinder-quobyte-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b" released by "delete_volume" :: held 0.853s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:30:29 devstack cinder-volume[94670]: WARNING cinder.quota [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-500207707-59554405 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-500207707-59554405, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:30:29 devstack cinder-volume[94670]: WARNING cinder.quota [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-500207707-59554405 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-500207707-59554405, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:30:29 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Created reservations ['dac822e7-6cb2-4054-a2fb-6652f95ea5e1', 'de99e3f0-1f34-4b6c-a765-9dbe88aa59df', '7b548edd-6d6c-4c21-bed8-139cab64c5a3', '3e7348ed-1cde-4afd-90a1-95d9ae3350f8'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:30:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:30:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:30:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:29 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:30:29 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:29 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.278s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:29 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:30:29 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Deleted volume successfully. Aug 13 09:30:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9bd1f089-8405-4e65-8c88-baecd891a74a tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "cinder-3ed7f56a-98bf-41bd-9a5a-4e02edf6b13b-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Flow 'volume_create_manager' (c982a561-49fe-4e23-9ff3-05993c5449fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89a466a-a70b-43c1-9591-a47403ac258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89a466a-a70b-43c1-9591-a47403ac258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-125103093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204eacfb-7a62-40b2-8944-71d96b8c746b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5911a10e3c4099890fdafcc375d955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:30:33Z,use_quota=True,user_id='7d7b3e659ccd4b3ba5bfbf5f0dce4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ea78fb-741d-4517-8c66-59d43f307e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ea78fb-741d-4517-8c66-59d43f307e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b100ffb-eca5-48fa-a59c-0599a96aba96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b100ffb-eca5-48fa-a59c-0599a96aba96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '204eacfb-7a62-40b2-8944-71d96b8c746b', 'volume_name': 'volume-204eacfb-7a62-40b2-8944-71d96b8c746b', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef33c48-eff5-428d-ad04-cb6fd51cd59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef33c48-eff5-428d-ad04-cb6fd51cd59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813550c1-bd86-40e1-8442-7c8e28e8ce6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:33 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Volume 204eacfb-7a62-40b2-8944-71d96b8c746b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-204eacfb-7a62-40b2-8944-71d96b8c746b', 'volume_size': 1} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-125103093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204eacfb-7a62-40b2-8944-71d96b8c746b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5911a10e3c4099890fdafcc375d955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:30:33Z,use_quota=True,user_id='7d7b3e659ccd4b3ba5bfbf5f0dce4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Creating volume 204eacfb-7a62-40b2-8944-71d96b8c746b {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:30:33 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-204eacfb-7a62-40b2-8944-71d96b8c746b 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:33 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-204eacfb-7a62-40b2-8944-71d96b8c746b 1073741824 Aug 13 09:30:33 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:33 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-cef33590-d88f-4b44-89aa-d66f19bbe93d req-bca6add9-3fbf-4b14-9254-c0528503dade tempest-TestInstancesWithCinderVolumes-143700902 None] Terminate volume connection completed successfully. Aug 13 09:30:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-cef33590-d88f-4b44-89aa-d66f19bbe93d req-bca6add9-3fbf-4b14-9254-c0528503dade tempest-TestInstancesWithCinderVolumes-143700902 None] Deleting attachment daf3b102-1f0b-4fbd-970f-2679d022186c. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Flow 'volume_create_manager' (4779e18f-3544-4ab7-abcd-0ddbe52ff2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25debb9-c7ef-486a-a994-60fab8b6c470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25debb9-c7ef-486a-a994-60fab8b6c470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-259261413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b598e6-2fb5-4426-91a7-333b9d19f258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5911a10e3c4099890fdafcc375d955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:30:34Z,use_quota=True,user_id='7d7b3e659ccd4b3ba5bfbf5f0dce4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c078cf-e2f2-469a-a611-036edf779eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c078cf-e2f2-469a-a611-036edf779eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abff1d0d-2f99-4f94-9b55-21f8881a799b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abff1d0d-2f99-4f94-9b55-21f8881a799b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53b598e6-2fb5-4426-91a7-333b9d19f258', 'volume_name': 'volume-53b598e6-2fb5-4426-91a7-333b9d19f258', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d075f703-8e21-42a4-ba6b-17195bcaff16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d075f703-8e21-42a4-ba6b-17195bcaff16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e197ae4b-d1b9-489e-972f-0e4df290747d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:34 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Volume 53b598e6-2fb5-4426-91a7-333b9d19f258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53b598e6-2fb5-4426-91a7-333b9d19f258', 'volume_size': 1} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:34 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-204eacfb-7a62-40b2-8944-71d96b8c746b 1073741824" returned: 0 in 0.999s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-204eacfb-7a62-40b2-8944-71d96b8c746b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:34 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-204eacfb-7a62-40b2-8944-71d96b8c746b Aug 13 09:30:34 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "cinder-7ee79052-34f2-4d34-ae26-bc7a36ddf162-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "cinder-7ee79052-34f2-4d34-ae26-bc7a36ddf162-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "cinder-quobyte-7ee79052-34f2-4d34-ae26-bc7a36ddf162" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:30:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "cinder-quobyte-7ee79052-34f2-4d34-ae26-bc7a36ddf162" acquired by "delete_volume" :: waited 0.036s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:30:35 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccc605d-e542-4edc-a740-6c8d55114826]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-204eacfb-7a62-40b2-8944-71d96b8c746b" returned: 0 in 0.554s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-259261413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b598e6-2fb5-4426-91a7-333b9d19f258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5911a10e3c4099890fdafcc375d955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:30:34Z,use_quota=True,user_id='7d7b3e659ccd4b3ba5bfbf5f0dce4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Creating volume 53b598e6-2fb5-4426-91a7-333b9d19f258 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:30:35 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-53b598e6-2fb5-4426-91a7-333b9d19f258 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:35 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-53b598e6-2fb5-4426-91a7-333b9d19f258 1073741824 Aug 13 09:30:35 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813550c1-bd86-40e1-8442-7c8e28e8ce6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-204eacfb-7a62-40b2-8944-71d96b8c746b', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c854536d-5cbd-45c1-92a3-8ac0ea0cbab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:35 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162 Aug 13 09:30:35 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:35 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Volume volume-204eacfb-7a62-40b2-8944-71d96b8c746b (204eacfb-7a62-40b2-8944-71d96b8c746b): created successfully Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c854536d-5cbd-45c1-92a3-8ac0ea0cbab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Flow 'volume_create_manager' (c982a561-49fe-4e23-9ff3-05993c5449fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:30:35 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-496cad7d-214e-4059-b064-73ba5e9f9214 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Created volume successfully. Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Flow 'volume_create_manager' (9c49649d-49b6-494f-8dda-ad655854b28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f437d5d-ddd5-4e14-b6b5-80d3050db259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f437d5d-ddd5-4e14-b6b5-80d3050db259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-124051535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f912c90-18c5-4d02-b7d0-d1a11b8c746b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d516e241eb9d4ee2ac980ad1801f78fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:30:35Z,use_quota=True,user_id='23b6787983954c208189481c7cecda57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c87f17-9728-476c-a46c-fd85993e4c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c87f17-9728-476c-a46c-fd85993e4c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d77c735-5ee4-434c-82c1-725e0786ea87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d77c735-5ee4-434c-82c1-725e0786ea87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f912c90-18c5-4d02-b7d0-d1a11b8c746b', 'volume_name': 'volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440228ac-8a95-488e-97fb-7463bbe84249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440228ac-8a95-488e-97fb-7463bbe84249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1d4817-12df-4ed8-acac-b7d9580a4faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:35 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Volume 0f912c90-18c5-4d02-b7d0-d1a11b8c746b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b', 'volume_size': 1} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:35 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162" returned: 0 in 0.663s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:35 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162 Aug 13 09:30:35 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:35 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-53b598e6-2fb5-4426-91a7-333b9d19f258 1073741824" returned: 0 in 0.816s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-53b598e6-2fb5-4426-91a7-333b9d19f258 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:36 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7ee79052-34f2-4d34-ae26-bc7a36ddf162" returned: 0 in 0.321s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:36 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-53b598e6-2fb5-4426-91a7-333b9d19f258 Aug 13 09:30:36 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "cinder-quobyte-7ee79052-34f2-4d34-ae26-bc7a36ddf162" released by "delete_volume" :: held 1.091s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:30:36 devstack cinder-volume[94670]: WARNING cinder.quota [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-334179094-1616088253 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-334179094-1616088253, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:30:36 devstack cinder-volume[94670]: WARNING cinder.quota [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-334179094-1616088253 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-334179094-1616088253, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Created reservations ['1d14e7d3-e8b3-48c9-8c19-0dbff69ba2d7', '0d7851c2-e1d9-42f8-b099-a22f6b54abe5', '934e9992-aaae-43d9-ab42-5c6b8eab8153', '143fa3f9-e219-4f23-b2a2-ad405f3fc9be'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:36 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:30:36 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:36 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-53b598e6-2fb5-4426-91a7-333b9d19f258" returned: 0 in 0.492s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.930s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-124051535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f912c90-18c5-4d02-b7d0-d1a11b8c746b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d516e241eb9d4ee2ac980ad1801f78fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:30:35Z,use_quota=True,user_id='23b6787983954c208189481c7cecda57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Creating volume 0f912c90-18c5-4d02-b7d0-d1a11b8c746b {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:30:36 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:36 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b 1073741824 Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e197ae4b-d1b9-489e-972f-0e4df290747d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53b598e6-2fb5-4426-91a7-333b9d19f258', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:36 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48fd5e96-028c-49a5-bfdd-397b624854c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:36 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Volume volume-53b598e6-2fb5-4426-91a7-333b9d19f258 (53b598e6-2fb5-4426-91a7-333b9d19f258): created successfully Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48fd5e96-028c-49a5-bfdd-397b624854c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Flow 'volume_create_manager' (4779e18f-3544-4ab7-abcd-0ddbe52ff2aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:30:36 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-226edab5-40c1-48e0-8dbd-b9c8cf258f66 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Created volume successfully. Aug 13 09:30:36 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.525s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:30:36 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Deleted volume successfully. Aug 13 09:30:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-03e30777-0e9a-4cdc-94e4-3e9c56157524 tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "cinder-7ee79052-34f2-4d34-ae26-bc7a36ddf162-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:30:37 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b 1073741824" returned: 0 in 0.942s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:37 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b Aug 13 09:30:37 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:37 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b" returned: 0 in 0.359s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:30:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1d4817-12df-4ed8-acac-b7d9580a4faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe99c6d1-ae02-4a76-807d-62828716ba2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:37 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Volume volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b (0f912c90-18c5-4d02-b7d0-d1a11b8c746b): created successfully Aug 13 09:30:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe99c6d1-ae02-4a76-807d-62828716ba2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Flow 'volume_create_manager' (9c49649d-49b6-494f-8dda-ad655854b28d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:30:37 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e77f1314-4276-4ad5-b112-44b966f32806 tempest-VolumesSnapshotTestJSON-44696910 None] Created volume successfully. Aug 13 09:30:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] Creating offline snapshot b75a4bbf-14a5-4646-b6bb-a68b8019fd7b of volume 0f912c90-18c5-4d02-b7d0-d1a11b8c746b {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:30:38 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b32a4ba-a236-433b-86d2-6bc941226534]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:30:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:39 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b Aug 13 09:30:39 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:39 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b" returned: 0 in 0.454s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:39 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b 1G Aug 13 09:30:39 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:40 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b 1G" returned: 0 in 0.697s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:40 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b Aug 13 09:30:40 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:40 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b" returned: 0 in 0.446s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:40 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b is being set with open permissions: ugo+rw Aug 13 09:30:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:40 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b Aug 13 09:30:40 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:41 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b" returned: 0 in 0.443s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:41 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.info Aug 13 09:30:41 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:41 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.info" returned: 0 in 0.422s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:41 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.info is being set with open permissions: ugo+rw Aug 13 09:30:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:41 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.info Aug 13 09:30:41 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:41 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.info" returned: 0 in 0.320s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.999s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:41 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-5ecc2bd8-510a-420a-9eca-7a804c15cb3c req-652bcbfc-e39b-496b-a77a-3978963554d8 tempest-TestInstancesWithCinderVolumes-143700902 None] Terminate volume connection completed successfully. Aug 13 09:30:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-5ecc2bd8-510a-420a-9eca-7a804c15cb3c req-652bcbfc-e39b-496b-a77a-3978963554d8 tempest-TestInstancesWithCinderVolumes-143700902 None] Deleting attachment 7622e76b-bf62-4529-bfaf-e49bfb524702. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:30:42 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e709c74b-ea3b-4992-a563-a70d9f375764 tempest-VolumesSnapshotTestJSON-44696910 None] Create snapshot completed successfully Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:43 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:30:43 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "cinder-789e1754-407a-463a-828f-17a03710ffe2-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "cinder-789e1754-407a-463a-828f-17a03710ffe2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "cinder-quobyte-789e1754-407a-463a-828f-17a03710ffe2" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-b75a4bbf-14a5-4646-b6bb-a68b8019fd7b-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-b75a4bbf-14a5-4646-b6bb-a68b8019fd7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "cinder-quobyte-789e1754-407a-463a-828f-17a03710ffe2" acquired by "delete_volume" :: waited 0.097s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f166b0-185e-4e6d-9d6a-e30e583e66ac]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-quobyte-0f912c90-18c5-4d02-b7d0-d1a11b8c746b" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-0f912c90-18c5-4d02-b7d0-d1a11b8c746b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-quobyte-b75a4bbf-14a5-4646-b6bb-a68b8019fd7b" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-b75a4bbf-14a5-4646-b6bb-a68b8019fd7b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Deleting offline snapshot b75a4bbf-14a5-4646-b6bb-a68b8019fd7b of volume 0f912c90-18c5-4d02-b7d0-d1a11b8c746b {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:30:43 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] snapshot_file for this snap is: volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.529s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc906475-c466-4a65-9441-450f404798d9]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:30:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:43 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 Aug 13 09:30:43 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:43 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b Aug 13 09:30:43 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:44 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2" returned: 0 in 0.502s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:44 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 Aug 13 09:30:44 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:44 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b" returned: 0 in 0.515s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:30:44 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[773d824d-c647-465d-b715-b1f9cf551bb0]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:30:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:44 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b Aug 13 09:30:44 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:44 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-ed3ffc28-fc5e-44c4-b491-1edd54bebfb9 req-75c4c33b-dc6c-49ea-8fdb-4b1ff1136e31 tempest-AttachVolumeNegativeTest-1910161388 None] Terminate volume connection completed successfully. Aug 13 09:30:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-ed3ffc28-fc5e-44c4-b491-1edd54bebfb9 req-75c4c33b-dc6c-49ea-8fdb-4b1ff1136e31 tempest-AttachVolumeNegativeTest-1910161388 None] Deleting attachment 4f9181f3-251a-4da7-b5d4-d61886f4aabc. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:30:44 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2" returned: 1 in 0.544s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:30:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:44 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2 Aug 13 09:30:44 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:44 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b" returned: 0 in 0.552s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:44 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b Aug 13 09:30:44 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:44 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-789e1754-407a-463a-828f-17a03710ffe2" returned: 0 in 0.346s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "cinder-quobyte-789e1754-407a-463a-828f-17a03710ffe2" released by "delete_volume" :: held 1.497s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:30:45 devstack cinder-volume[94670]: WARNING cinder.quota [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1138118700-2143265737 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1138118700-2143265737, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:30:45 devstack cinder-volume[94670]: WARNING cinder.quota [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1138118700-2143265737 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1138118700-2143265737, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:30:45 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Created reservations ['0b909bd8-a6c9-4039-9674-b7b7a5a48777', 'f5cfabcb-c6fa-4792-9824-3adfac8efb27', 'ac626e9b-d4a2-4df5-a175-63d53b280156', 'bd122a44-d366-4920-9740-4ba2e0dc7a30'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:30:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:30:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:30:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:45 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:30:45 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:45 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b" returned: 0 in 0.581s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:45 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b Aug 13 09:30:45 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:45 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.573s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:45 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:30:45 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Deleted volume successfully. Aug 13 09:30:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-024ed13d-ec04-40e8-bf61-1f9b6efa406b tempest-TestInstancesWithCinderVolumes-143700902 None] Lock "cinder-789e1754-407a-463a-828f-17a03710ffe2-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:30:46 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b.b75a4bbf-14a5-4646-b6bb-a68b8019fd7b" returned: 0 in 0.513s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-b75a4bbf-14a5-4646-b6bb-a68b8019fd7b" released by "_delete_snapshot" :: held 2.364s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:30:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-0f912c90-18c5-4d02-b7d0-d1a11b8c746b" released by "delete_snapshot" :: held 2.407s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:30:46 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Created reservations ['0fca9d0a-91f8-4adb-b71f-3e670358211c', '1566f672-d147-468b-b50e-a87bc47f09e4', '1ddb7f4e-98da-4d74-92a3-fd4281268c06', '096466c6-f353-448e-8c16-214da9b3ce45'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:30:46 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Delete snapshot completed successfully. Aug 13 09:30:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8ac6ae96-d684-4ca6-ba61-e6a586c5a634 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-b75a4bbf-14a5-4646-b6bb-a68b8019fd7b-delete_snapshot" released by "delete_snapshot" :: held 2.927s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Flow 'volume_create_manager' (8415a053-3993-484b-8de2-ac1b4c1e3566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c78f85e-f160-4b36-a245-69149a8e7df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c78f85e-f160-4b36-a245-69149a8e7df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1560323426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52feac4a-78ca-45bc-b081-101742c9fb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d516e241eb9d4ee2ac980ad1801f78fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:30:48Z,use_quota=True,user_id='23b6787983954c208189481c7cecda57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e506422b-5869-42e6-91ac-79b90c965d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e506422b-5869-42e6-91ac-79b90c965d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0a2cb3-3447-4388-9852-4cf8ce085f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0a2cb3-3447-4388-9852-4cf8ce085f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52feac4a-78ca-45bc-b081-101742c9fb00', 'volume_name': 'volume-52feac4a-78ca-45bc-b081-101742c9fb00', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815f58e1-24d0-4ad9-bda4-188d08c6fb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815f58e1-24d0-4ad9-bda4-188d08c6fb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a0dd4b-c588-47a6-b8a8-6d0140068792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:47 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Volume 52feac4a-78ca-45bc-b081-101742c9fb00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52feac4a-78ca-45bc-b081-101742c9fb00', 'volume_size': 1} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1560323426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52feac4a-78ca-45bc-b081-101742c9fb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d516e241eb9d4ee2ac980ad1801f78fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:30:48Z,use_quota=True,user_id='23b6787983954c208189481c7cecda57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Creating volume 52feac4a-78ca-45bc-b081-101742c9fb00 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:30:47 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:30:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:47 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 1073741824 Aug 13 09:30:47 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:48 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 1073741824" returned: 0 in 0.579s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:48 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 Aug 13 09:30:48 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:48 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00" returned: 0 in 0.345s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:30:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a0dd4b-c588-47a6-b8a8-6d0140068792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52feac4a-78ca-45bc-b081-101742c9fb00', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e602ece3-521d-4e16-a56e-e0178e3ff49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:48 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Volume volume-52feac4a-78ca-45bc-b081-101742c9fb00 (52feac4a-78ca-45bc-b081-101742c9fb00): created successfully Aug 13 09:30:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e602ece3-521d-4e16-a56e-e0178e3ff49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Flow 'volume_create_manager' (8415a053-3993-484b-8de2-ac1b4c1e3566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:30:48 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-09713da1-15a5-461a-beca-06eb3599f848 tempest-VolumesSnapshotTestJSON-44696910 None] Created volume successfully. Aug 13 09:30:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] Creating offline snapshot ca731e84-9bdf-4eb5-9be5-4d0f157b6692 of volume 52feac4a-78ca-45bc-b081-101742c9fb00 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:30:50 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cf4bea-23b6-47f1-b363-816f2c2c7998]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:30:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:50 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 Aug 13 09:30:50 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:50 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00" returned: 0 in 0.617s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:50 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 1G Aug 13 09:30:50 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:51 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 1G" returned: 0 in 0.809s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52feac4a-78ca-45bc-b081-101742c9fb00 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:51 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52feac4a-78ca-45bc-b081-101742c9fb00 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 Aug 13 09:30:51 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:52 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52feac4a-78ca-45bc-b081-101742c9fb00 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692" returned: 0 in 0.574s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:52 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 is being set with open permissions: ugo+rw Aug 13 09:30:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:52 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 Aug 13 09:30:52 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:52 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692" returned: 0 in 0.349s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:52 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.info Aug 13 09:30:52 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:52 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.info" returned: 0 in 0.328s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:52 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.info is being set with open permissions: ugo+rw Aug 13 09:30:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:52 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.info Aug 13 09:30:52 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:53 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.info" returned: 0 in 0.463s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.287s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:53 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-74e2d658-2202-4fa2-9a72-f0b5539c5093 tempest-VolumesSnapshotTestJSON-44696910 None] Create snapshot completed successfully Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Flow 'volume_create_manager' (3bdb9dcf-6148-4571-9122-4a8f2f86ec73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d218a813-7b6d-4d2d-b36a-ef209309c65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d218a813-7b6d-4d2d-b36a-ef209309c65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-191010211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8497d161-0650-46d9-80fb-f9638bdb1ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d516e241eb9d4ee2ac980ad1801f78fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:30:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ca731e84-9bdf-4eb5-9be5-4d0f157b6692,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:30:55Z,use_quota=True,user_id='23b6787983954c208189481c7cecda57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b94706-fd32-4357-9f77-bbb51585fb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b94706-fd32-4357-9f77-bbb51585fb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c01dc2-a66c-42a8-bc78-6dc99142aa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c01dc2-a66c-42a8-bc78-6dc99142aa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8497d161-0650-46d9-80fb-f9638bdb1ce5', 'volume_name': 'volume-8497d161-0650-46d9-80fb-f9638bdb1ce5', 'volume_size': 2, 'snapshot_id': 'ca731e84-9bdf-4eb5-9be5-4d0f157b6692'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc6089d-8d4b-4f88-b2e8-17be5aff47a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc6089d-8d4b-4f88-b2e8-17be5aff47a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b7cdc7-cd81-4f7d-9479-86e18b073dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:30:55 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Volume 8497d161-0650-46d9-80fb-f9638bdb1ce5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8497d161-0650-46d9-80fb-f9638bdb1ce5', 'volume_size': 2, 'snapshot_id': 'ca731e84-9bdf-4eb5-9be5-4d0f157b6692'} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-quobyte-ca731e84-9bdf-4eb5-9be5-4d0f157b6692-8497d161-0650-46d9-80fb-f9638bdb1ce5" by "_create_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-ca731e84-9bdf-4eb5-9be5-4d0f157b6692-8497d161-0650-46d9-80fb-f9638bdb1ce5" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Creating volume 8497d161-0650-46d9-80fb-f9638bdb1ce5 from snapshot ca731e84-9bdf-4eb5-9be5-4d0f157b6692 {{(pid=94670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-quobyte-8497d161-0650-46d9-80fb-f9638bdb1ce5" by "_copy_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-8497d161-0650-46d9-80fb-f9638bdb1ce5" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] snapshot: ca731e84-9bdf-4eb5-9be5-4d0f157b6692, volume: 8497d161-0650-46d9-80fb-f9638bdb1ce5, {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a937c907-ed32-4402-90bf-2dbbac0aec97]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:30:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:55 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 Aug 13 09:30:56 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:56 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692" returned: 0 in 0.783s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52feac4a-78ca-45bc-b081-101742c9fb00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:30:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 13 09:30:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Creating direct copy from snapshot {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 13 09:30:56 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0888975d-f1de-48db-8af2-1a47c3e22bbb]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:30:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:56 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 Aug 13 09:30:56 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:30:57 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Aug 13 09:30:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00" returned: 0 in 0.490s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:30:57 devstack cinder-volume[94670]: DEBUG cinder.utils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Path /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8497d161-0650-46d9-80fb-f9638bdb1ce5 not found in is_blk_device check {{(pid=94670) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 13 09:30:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8497d161-0650-46d9-80fb-f9638bdb1ce5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:30:57 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8497d161-0650-46d9-80fb-f9638bdb1ce5 Aug 13 09:30:57 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:03 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8497d161-0650-46d9-80fb-f9638bdb1ce5" returned: 0 in 6.784s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:03 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e972da-b7f6-483a-8695-70e0a177a9dc]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:04 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 Aug 13 09:31:04 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:04 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00" returned: 0 in 0.899s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:04 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Image conversion details: src /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00, size 1024.00 MB, duration 6.79 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8497d161-0650-46d9-80fb-f9638bdb1ce5 {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:31:04 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Converted 1024.00 MB image at 150.91 MB/s Aug 13 09:31:04 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8497d161-0650-46d9-80fb-f9638bdb1ce5 is being set with open permissions: ugo+rw Aug 13 09:31:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8497d161-0650-46d9-80fb-f9638bdb1ce5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:04 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8497d161-0650-46d9-80fb-f9638bdb1ce5 Aug 13 09:31:04 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:05 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8497d161-0650-46d9-80fb-f9638bdb1ce5" returned: 0 in 0.308s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-8497d161-0650-46d9-80fb-f9638bdb1ce5" released by "_copy_volume_from_snapshot" :: held 9.415s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-ca731e84-9bdf-4eb5-9be5-4d0f157b6692-8497d161-0650-46d9-80fb-f9638bdb1ce5" released by "_create_volume_from_snapshot" :: held 9.469s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.503s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b7cdc7-cd81-4f7d-9479-86e18b073dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8497d161-0650-46d9-80fb-f9638bdb1ce5', 'volume_size': 2, 'snapshot_id': 'ca731e84-9bdf-4eb5-9be5-4d0f157b6692'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabf28ad-2b2c-42a2-96c1-cc3714b59e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:05 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Volume volume-8497d161-0650-46d9-80fb-f9638bdb1ce5 (8497d161-0650-46d9-80fb-f9638bdb1ce5): created successfully Aug 13 09:31:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabf28ad-2b2c-42a2-96c1-cc3714b59e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Flow 'volume_create_manager' (3bdb9dcf-6148-4571-9122-4a8f2f86ec73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:31:05 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b484d34d-daac-4d58-a416-1246d477b7be tempest-VolumesSnapshotTestJSON-44696910 None] Created volume successfully. Aug 13 09:31:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-8497d161-0650-46d9-80fb-f9638bdb1ce5-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-8497d161-0650-46d9-80fb-f9638bdb1ce5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-quobyte-8497d161-0650-46d9-80fb-f9638bdb1ce5" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-8497d161-0650-46d9-80fb-f9638bdb1ce5" acquired by "delete_volume" :: waited 0.032s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:06 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff253701-506f-43d9-9ee6-d4183ba336d1]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8497d161-0650-46d9-80fb-f9638bdb1ce5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:06 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8497d161-0650-46d9-80fb-f9638bdb1ce5 Aug 13 09:31:06 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:06 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8497d161-0650-46d9-80fb-f9638bdb1ce5" returned: 0 in 0.675s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8497d161-0650-46d9-80fb-f9638bdb1ce5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:07 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8497d161-0650-46d9-80fb-f9638bdb1ce5 Aug 13 09:31:07 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:07 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8497d161-0650-46d9-80fb-f9638bdb1ce5" returned: 0 in 0.553s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-8497d161-0650-46d9-80fb-f9638bdb1ce5" released by "delete_volume" :: held 1.309s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:07 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Created reservations ['7aaaf1f9-9060-4f36-8c10-77807386dcab', '592edb90-9614-44f0-af6d-ce43787624a5', 'a3478f7a-68a5-476e-96b3-df5888c8e445', 'cb0736a1-94e7-4a01-aba8-48c910d9e862'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:31:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:31:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:31:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:07 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:31:07 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:08 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.397s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:08 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:31:08 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Deleted volume successfully. Aug 13 09:31:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-377725a4-41f2-48c1-baa5-6997dde10a36 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-8497d161-0650-46d9-80fb-f9638bdb1ce5-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-ca731e84-9bdf-4eb5-9be5-4d0f157b6692-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-ca731e84-9bdf-4eb5-9be5-4d0f157b6692-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-quobyte-52feac4a-78ca-45bc-b081-101742c9fb00" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-52feac4a-78ca-45bc-b081-101742c9fb00" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-quobyte-ca731e84-9bdf-4eb5-9be5-4d0f157b6692" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-ca731e84-9bdf-4eb5-9be5-4d0f157b6692" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Deleting offline snapshot ca731e84-9bdf-4eb5-9be5-4d0f157b6692 of volume 52feac4a-78ca-45bc-b081-101742c9fb00 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:31:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] snapshot_file for this snap is: volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:31:08 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbb1f1e-9871-4a3b-b5dc-3cc48f95e288]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:08 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 Aug 13 09:31:08 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:09 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692" returned: 0 in 0.435s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:09 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52feac4a-78ca-45bc-b081-101742c9fb00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:31:09 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8041ba7-75ab-470d-98e6-52cbeb8d2262]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:09 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 Aug 13 09:31:09 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:09 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00" returned: 0 in 0.483s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:09 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 Aug 13 09:31:09 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:10 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692" returned: 0 in 0.471s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:10 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692 Aug 13 09:31:10 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:10 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00.ca731e84-9bdf-4eb5-9be5-4d0f157b6692" returned: 0 in 0.312s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-ca731e84-9bdf-4eb5-9be5-4d0f157b6692" released by "_delete_snapshot" :: held 1.853s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-52feac4a-78ca-45bc-b081-101742c9fb00" released by "delete_snapshot" :: held 1.893s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:10 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Created reservations ['e7e2e65b-b8e6-4bb9-bd34-d1e2c867255c', '6494d0ce-f9dd-480d-aadf-f586ce96c068', 'c620e049-b846-4c09-a3f2-d67c4b24c3c1', 'd3c711b5-48b8-498e-beaa-ac16dfdc2390'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:31:10 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Delete snapshot completed successfully. Aug 13 09:31:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-51426df6-c90c-421a-b064-a52baafbf009 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-ca731e84-9bdf-4eb5-9be5-4d0f157b6692-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-52feac4a-78ca-45bc-b081-101742c9fb00-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-52feac4a-78ca-45bc-b081-101742c9fb00-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-quobyte-52feac4a-78ca-45bc-b081-101742c9fb00" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-52feac4a-78ca-45bc-b081-101742c9fb00" acquired by "delete_volume" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:11 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc31fb7-a854-4a6c-9f46-1b2042d4a280]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:11 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 Aug 13 09:31:11 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:11 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00" returned: 0 in 0.709s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:12 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00 Aug 13 09:31:12 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:12 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-52feac4a-78ca-45bc-b081-101742c9fb00" returned: 0 in 0.368s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-52feac4a-78ca-45bc-b081-101742c9fb00" released by "delete_volume" :: held 1.231s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:12 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Created reservations ['3c135f20-7fd3-42d0-96f5-1bed8efc490c', 'd7671418-f89a-45d0-86b6-bea0ee737a84', '8f8865b1-bf10-4f5a-b48a-17c95410af4b', '0e270bb8-3297-439b-a14d-7896e64d7f9b'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:31:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:31:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:31:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:12 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:31:12 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:12 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.310s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:12 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:31:12 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Deleted volume successfully. Aug 13 09:31:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c15f2fe7-fc55-47a9-8ade-2f3bca6a0675 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-52feac4a-78ca-45bc-b081-101742c9fb00-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=76,cinder:UPDATE=76,cinder:INSERT=19,cinder:DELETE=5 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=85,cinder:UPDATE=85,cinder:INSERT=19,cinder:DELETE=8 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Flow 'volume_create_manager' (930edc9c-b9a9-4990-bc99-b7ff2c766bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e428878-7ca8-4248-9f9c-601d85d2c35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e428878-7ca8-4248-9f9c-601d85d2c35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1360939491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cfa3963-154d-4e01-9461-d8dff1dcbda8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d516e241eb9d4ee2ac980ad1801f78fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:31:14Z,use_quota=True,user_id='23b6787983954c208189481c7cecda57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4452ea-69c4-4921-bf8f-6161f9155843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4452ea-69c4-4921-bf8f-6161f9155843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142f8621-73d8-4e7c-aadb-7cf7e2d64275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142f8621-73d8-4e7c-aadb-7cf7e2d64275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cfa3963-154d-4e01-9461-d8dff1dcbda8', 'volume_name': 'volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6612bb0-7f39-4c78-8366-9a7ad663cdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6612bb0-7f39-4c78-8366-9a7ad663cdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2059564-1da4-40ab-97e6-47deb80b0c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:14 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Volume 9cfa3963-154d-4e01-9461-d8dff1dcbda8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8', 'volume_size': 1} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1360939491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cfa3963-154d-4e01-9461-d8dff1dcbda8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d516e241eb9d4ee2ac980ad1801f78fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:31:14Z,use_quota=True,user_id='23b6787983954c208189481c7cecda57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Creating volume 9cfa3963-154d-4e01-9461-d8dff1dcbda8 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:31:14 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:31:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:14 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 1073741824 Aug 13 09:31:14 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:15 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 1073741824" returned: 0 in 0.846s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:15 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 Aug 13 09:31:15 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:16 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8" returned: 0 in 0.714s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:31:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2059564-1da4-40ab-97e6-47deb80b0c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124fe601-f045-4bcf-a60d-9f19cb2e2d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:16 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Volume volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 (9cfa3963-154d-4e01-9461-d8dff1dcbda8): created successfully Aug 13 09:31:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124fe601-f045-4bcf-a60d-9f19cb2e2d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Flow 'volume_create_manager' (930edc9c-b9a9-4990-bc99-b7ff2c766bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:31:16 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d95ae245-9853-4ee4-bef1-5d2b3901ccd8 tempest-VolumesSnapshotTestJSON-44696910 None] Created volume successfully. Aug 13 09:31:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] Creating offline snapshot 67b0dc54-184c-48b4-99a8-c3288ba30bdb of volume 9cfa3963-154d-4e01-9461-d8dff1dcbda8 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:31:16 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1477a424-843d-4a83-b8c7-91c2de5f6c8b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:17 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 Aug 13 09:31:17 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:17 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8" returned: 0 in 0.808s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:17 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb 1G Aug 13 09:31:17 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:18 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb 1G" returned: 0 in 0.751s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:18 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb Aug 13 09:31:18 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:18 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb" returned: 0 in 0.424s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:18 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb is being set with open permissions: ugo+rw Aug 13 09:31:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:18 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb Aug 13 09:31:18 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:19 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb" returned: 0 in 0.386s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:19 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.info Aug 13 09:31:19 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:19 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.info" returned: 0 in 0.447s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:19 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.info is being set with open permissions: ugo+rw Aug 13 09:31:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:19 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.info Aug 13 09:31:19 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:20 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.info" returned: 0 in 0.405s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.416s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:20 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d6fc2ef1-71e4-414b-b303-f6ca168cbe47 tempest-VolumesSnapshotTestJSON-44696910 None] Create snapshot completed successfully Aug 13 09:31:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-0af0a365-da97-4017-a3d8-8a1f9be9c003 req-1b2558de-4df7-4a93-a886-95720ecc090c tempest-TestServerVolumeAttachmentScenario-1133447939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-0af0a365-da97-4017-a3d8-8a1f9be9c003 req-1b2558de-4df7-4a93-a886-95720ecc090c tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:20 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[925628f8-c1cd-4d5d-af8d-75fced79bd59]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-0af0a365-da97-4017-a3d8-8a1f9be9c003 req-1b2558de-4df7-4a93-a886-95720ecc090c tempest-TestServerVolumeAttachmentScenario-1133447939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-204eacfb-7a62-40b2-8944-71d96b8c746b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:20 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-204eacfb-7a62-40b2-8944-71d96b8c746b Aug 13 09:31:20 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:20 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-0af0a365-da97-4017-a3d8-8a1f9be9c003 req-1b2558de-4df7-4a93-a886-95720ecc090c tempest-TestServerVolumeAttachmentScenario-1133447939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-204eacfb-7a62-40b2-8944-71d96b8c746b" returned: 0 in 0.456s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-0af0a365-da97-4017-a3d8-8a1f9be9c003 req-1b2558de-4df7-4a93-a886-95720ecc090c tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.485s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-0af0a365-da97-4017-a3d8-8a1f9be9c003 req-1b2558de-4df7-4a93-a886-95720ecc090c tempest-TestServerVolumeAttachmentScenario-1133447939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-204eacfb-7a62-40b2-8944-71d96b8c746b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23900b35-a659-4046-b106-d8e5a9c4f2dd', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:31:21 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-0af0a365-da97-4017-a3d8-8a1f9be9c003 req-1b2558de-4df7-4a93-a886-95720ecc090c tempest-TestServerVolumeAttachmentScenario-1133447939 None] attachment_update completed successfully. Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Flow 'volume_create_manager' (0cc04710-d053-4591-90e1-c402cff8e96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f405a10-4665-454c-a744-2220c1505379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f405a10-4665-454c-a744-2220c1505379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1169901351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f740ec7d-4908-4055-ab0c-e5438b58e067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d516e241eb9d4ee2ac980ad1801f78fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=67b0dc54-184c-48b4-99a8-c3288ba30bdb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:31:22Z,use_quota=True,user_id='23b6787983954c208189481c7cecda57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86576ee1-7f66-4ea2-a8bc-ad29d022a602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86576ee1-7f66-4ea2-a8bc-ad29d022a602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997442f1-9eeb-4865-b592-4814483d03a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997442f1-9eeb-4865-b592-4814483d03a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f740ec7d-4908-4055-ab0c-e5438b58e067', 'volume_name': 'volume-f740ec7d-4908-4055-ab0c-e5438b58e067', 'volume_size': 1, 'snapshot_id': '67b0dc54-184c-48b4-99a8-c3288ba30bdb'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b9a8c3-d17e-4c4f-89b7-700ec9834550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b9a8c3-d17e-4c4f-89b7-700ec9834550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30c0eca-fb87-483d-97b2-77c028e8ca0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:22 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Volume f740ec7d-4908-4055-ab0c-e5438b58e067: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f740ec7d-4908-4055-ab0c-e5438b58e067', 'volume_size': 1, 'snapshot_id': '67b0dc54-184c-48b4-99a8-c3288ba30bdb'} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-quobyte-67b0dc54-184c-48b4-99a8-c3288ba30bdb-f740ec7d-4908-4055-ab0c-e5438b58e067" by "_create_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-67b0dc54-184c-48b4-99a8-c3288ba30bdb-f740ec7d-4908-4055-ab0c-e5438b58e067" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Creating volume f740ec7d-4908-4055-ab0c-e5438b58e067 from snapshot 67b0dc54-184c-48b4-99a8-c3288ba30bdb {{(pid=94670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-quobyte-f740ec7d-4908-4055-ab0c-e5438b58e067" by "_copy_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-f740ec7d-4908-4055-ab0c-e5438b58e067" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] snapshot: 67b0dc54-184c-48b4-99a8-c3288ba30bdb, volume: f740ec7d-4908-4055-ab0c-e5438b58e067, {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec144da-c03c-4ccf-b87c-71642d343d5e]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:22 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb Aug 13 09:31:22 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:23 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb" returned: 0 in 0.643s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:31:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 13 09:31:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Creating direct copy from snapshot {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 13 09:31:23 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7ba75f-31ad-40bb-a721-d43232f83b9b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:23 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 Aug 13 09:31:23 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:23 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8" returned: 0 in 0.610s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:23 devstack cinder-volume[94670]: DEBUG cinder.utils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Path /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f740ec7d-4908-4055-ab0c-e5438b58e067 not found in is_blk_device check {{(pid=94670) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 13 09:31:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f740ec7d-4908-4055-ab0c-e5438b58e067 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:23 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f740ec7d-4908-4055-ab0c-e5438b58e067 Aug 13 09:31:23 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:30 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f740ec7d-4908-4055-ab0c-e5438b58e067" returned: 0 in 6.760s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:30 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9561b5f-d08e-45a6-8019-18e6a369620b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-a666513b-b408-415e-acb5-b440e3d72b3f req-df760b89-dbdb-40e8-a098-045781277de7 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:30 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 Aug 13 09:31:30 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:31 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8" returned: 0 in 0.534s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Image conversion details: src /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8, size 1024.00 MB, duration 6.76 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f740ec7d-4908-4055-ab0c-e5438b58e067 {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:31:31 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Converted 1024.00 MB image at 151.44 MB/s Aug 13 09:31:31 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f740ec7d-4908-4055-ab0c-e5438b58e067 is being set with open permissions: ugo+rw Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f740ec7d-4908-4055-ab0c-e5438b58e067 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:31 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f740ec7d-4908-4055-ab0c-e5438b58e067 Aug 13 09:31:31 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:31 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f740ec7d-4908-4055-ab0c-e5438b58e067" returned: 0 in 0.278s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-f740ec7d-4908-4055-ab0c-e5438b58e067" released by "_copy_volume_from_snapshot" :: held 9.009s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-67b0dc54-184c-48b4-99a8-c3288ba30bdb-f740ec7d-4908-4055-ab0c-e5438b58e067" released by "_create_volume_from_snapshot" :: held 9.066s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.095s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-a666513b-b408-415e-acb5-b440e3d72b3f req-df760b89-dbdb-40e8-a098-045781277de7 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.797s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[45217a83-40d0-45f2-948a-0d46cac3e73f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-a666513b-b408-415e-acb5-b440e3d72b3f req-df760b89-dbdb-40e8-a098-045781277de7 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-53b598e6-2fb5-4426-91a7-333b9d19f258 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30c0eca-fb87-483d-97b2-77c028e8ca0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f740ec7d-4908-4055-ab0c-e5438b58e067', 'volume_size': 1, 'snapshot_id': '67b0dc54-184c-48b4-99a8-c3288ba30bdb'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ccc9bc-da58-420e-ab39-bf456d7d252e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:31 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Volume volume-f740ec7d-4908-4055-ab0c-e5438b58e067 (f740ec7d-4908-4055-ab0c-e5438b58e067): created successfully Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ccc9bc-da58-420e-ab39-bf456d7d252e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:31 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-53b598e6-2fb5-4426-91a7-333b9d19f258 Aug 13 09:31:31 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Flow 'volume_create_manager' (0cc04710-d053-4591-90e1-c402cff8e96c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:31:31 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-f6367cf8-9e30-4e39-b602-bd323c6b3d92 tempest-VolumesSnapshotTestJSON-44696910 None] Created volume successfully. Aug 13 09:31:31 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-a666513b-b408-415e-acb5-b440e3d72b3f req-df760b89-dbdb-40e8-a098-045781277de7 tempest-TestServerVolumeAttachmentScenario-1133447939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-53b598e6-2fb5-4426-91a7-333b9d19f258" returned: 0 in 0.406s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-a666513b-b408-415e-acb5-b440e3d72b3f req-df760b89-dbdb-40e8-a098-045781277de7 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.437s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-a666513b-b408-415e-acb5-b440e3d72b3f req-df760b89-dbdb-40e8-a098-045781277de7 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-53b598e6-2fb5-4426-91a7-333b9d19f258', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d7b8e02-392a-4a89-a172-71871cf80435', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:31:32 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-a666513b-b408-415e-acb5-b440e3d72b3f req-df760b89-dbdb-40e8-a098-045781277de7 tempest-TestServerVolumeAttachmentScenario-1133447939 None] attachment_update completed successfully. Aug 13 09:31:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-f740ec7d-4908-4055-ab0c-e5438b58e067-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-f740ec7d-4908-4055-ab0c-e5438b58e067-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:33 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-quobyte-f740ec7d-4908-4055-ab0c-e5438b58e067" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:33 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-f740ec7d-4908-4055-ab0c-e5438b58e067" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:33 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[464591fd-b4d0-4f76-b5b6-da4041010737]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f740ec7d-4908-4055-ab0c-e5438b58e067 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:33 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f740ec7d-4908-4055-ab0c-e5438b58e067 Aug 13 09:31:33 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:33 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f740ec7d-4908-4055-ab0c-e5438b58e067" returned: 0 in 0.415s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f740ec7d-4908-4055-ab0c-e5438b58e067 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:33 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f740ec7d-4908-4055-ab0c-e5438b58e067 Aug 13 09:31:33 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:33 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f740ec7d-4908-4055-ab0c-e5438b58e067" returned: 0 in 0.338s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:33 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-f740ec7d-4908-4055-ab0c-e5438b58e067" released by "delete_volume" :: held 0.815s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:33 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Created reservations ['741d6881-7bfc-4c9e-97be-38a445292f59', '43fa862c-004a-4e5f-86cd-34ee8d2cc8f6', 'fbbee12e-d4e8-427b-9bf0-0ab880bf4002', '3b767db8-eea3-4890-a284-05513756f6a6'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:34 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:31:34 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-67b0dc54-184c-48b4-99a8-c3288ba30bdb-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-67b0dc54-184c-48b4-99a8-c3288ba30bdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-quobyte-9cfa3963-154d-4e01-9461-d8dff1dcbda8" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-9cfa3963-154d-4e01-9461-d8dff1dcbda8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-quobyte-67b0dc54-184c-48b4-99a8-c3288ba30bdb" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:34 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-67b0dc54-184c-48b4-99a8-c3288ba30bdb" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Deleting offline snapshot 67b0dc54-184c-48b4-99a8-c3288ba30bdb of volume 9cfa3963-154d-4e01-9461-d8dff1dcbda8 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] snapshot_file for this snap is: volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.408s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f45fc0-5b20-4df8-9aa7-db15adddb4c6]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:34 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Deleted volume successfully. Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1d72bc14-648d-463b-b552-fa4830aaa240 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-f740ec7d-4908-4055-ab0c-e5438b58e067-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:34 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb Aug 13 09:31:34 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:34 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-08a37413-917a-44fe-a1d8-b25ffb123bde req-3160b490-f1ab-44d3-9617-7f6d21b217fc tempest-TestServerVolumeAttachmentScenario-1133447939 None] Terminate volume connection completed successfully. Aug 13 09:31:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-08a37413-917a-44fe-a1d8-b25ffb123bde req-3160b490-f1ab-44d3-9617-7f6d21b217fc tempest-TestServerVolumeAttachmentScenario-1133447939 None] Deleting attachment 7d7b8e02-392a-4a89-a172-71871cf80435. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:31:35 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb" returned: 0 in 0.576s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:31:35 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c416a7-d9c2-47e0-b74a-381d279179c3]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:35 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 Aug 13 09:31:35 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:35 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8" returned: 0 in 0.532s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:35 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb Aug 13 09:31:35 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:35 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb" returned: 0 in 0.422s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:36 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb Aug 13 09:31:36 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:36 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-a3ec9955-0951-4458-8e52-f7ade12914c4 req-a03575cd-3dae-4ff5-bdc2-1693443943d1 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Terminate volume connection completed successfully. Aug 13 09:31:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-a3ec9955-0951-4458-8e52-f7ade12914c4 req-a03575cd-3dae-4ff5-bdc2-1693443943d1 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Deleting attachment 23900b35-a659-4046-b106-d8e5a9c4f2dd. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:31:36 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8.67b0dc54-184c-48b4-99a8-c3288ba30bdb" returned: 0 in 0.344s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-67b0dc54-184c-48b4-99a8-c3288ba30bdb" released by "_delete_snapshot" :: held 2.079s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-9cfa3963-154d-4e01-9461-d8dff1dcbda8" released by "delete_snapshot" :: held 2.128s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:36 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Created reservations ['22f61264-b9de-4fef-b4ec-6139a7954b39', 'baaa0f18-aa0a-4da4-8e81-a0d3d5a31326', '8a323cde-88a2-4613-b500-d3d13deb7b94', 'c51c4993-f395-48ee-9b2e-f159e0eb88ec'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:31:36 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Delete snapshot completed successfully. Aug 13 09:31:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8115d6fd-86bd-41e1-bde7-20a4a892334f tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-67b0dc54-184c-48b4-99a8-c3288ba30bdb-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-9cfa3963-154d-4e01-9461-d8dff1dcbda8-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-9cfa3963-154d-4e01-9461-d8dff1dcbda8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-quobyte-9cfa3963-154d-4e01-9461-d8dff1dcbda8" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-9cfa3963-154d-4e01-9461-d8dff1dcbda8" acquired by "delete_volume" :: waited 0.040s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:37 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8bfcbe-77e7-435b-9bc8-da524b0503a6]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:37 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:31:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Flow 'volume_create_manager' (e9d0f31a-b4f9-46a3-9bea-a25bd8703720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e4f860-6356-40e8-bcdf-6985b11e7ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e4f860-6356-40e8-bcdf-6985b11e7ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-16015128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58d0cff-fd0d-40cd-a878-865bdc917da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87add6622ea430ea7954ec9756993dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:31:38Z,use_quota=True,user_id='a38f1dfac54e4411a17ec5b029e6ef20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66571431-344a-4323-8068-2bac2c1753c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66571431-344a-4323-8068-2bac2c1753c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06361c7-82a1-4905-ab5e-faeef6b82a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06361c7-82a1-4905-ab5e-faeef6b82a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e58d0cff-fd0d-40cd-a878-865bdc917da5', 'volume_name': 'volume-e58d0cff-fd0d-40cd-a878-865bdc917da5', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eabee7f-7e6d-44c9-8fb9-121a9144f9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eabee7f-7e6d-44c9-8fb9-121a9144f9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7eddad-2f80-4684-b9b6-1173ca342ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:38 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Volume e58d0cff-fd0d-40cd-a878-865bdc917da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e58d0cff-fd0d-40cd-a878-865bdc917da5', 'volume_size': 1} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-16015128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58d0cff-fd0d-40cd-a878-865bdc917da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87add6622ea430ea7954ec9756993dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:31:38Z,use_quota=True,user_id='a38f1dfac54e4411a17ec5b029e6ef20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Creating volume e58d0cff-fd0d-40cd-a878-865bdc917da5 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:31:38 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 Aug 13 09:31:38 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:31:38 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e58d0cff-fd0d-40cd-a878-865bdc917da5 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:38 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e58d0cff-fd0d-40cd-a878-865bdc917da5 1073741824 Aug 13 09:31:38 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:38 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8" returned: 0 in 0.564s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:38 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8 Aug 13 09:31:38 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:38 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e58d0cff-fd0d-40cd-a878-865bdc917da5 1073741824" returned: 0 in 0.742s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:38 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9cfa3963-154d-4e01-9461-d8dff1dcbda8" returned: 0 in 0.394s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-9cfa3963-154d-4e01-9461-d8dff1dcbda8" released by "delete_volume" :: held 1.060s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e58d0cff-fd0d-40cd-a878-865bdc917da5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:38 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e58d0cff-fd0d-40cd-a878-865bdc917da5 Aug 13 09:31:38 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Created reservations ['bb91c134-69d6-459b-81a4-e70633224b00', 'd15b5cbe-903e-47b1-bb23-b47d997424b7', '91392d4a-5bd3-41ed-ab12-dce53ecd37fb', 'a64a159d-ba66-43b3-ac67-628c2164d35d'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:39 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:31:39 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:39 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e58d0cff-fd0d-40cd-a878-865bdc917da5" returned: 0 in 0.591s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:39 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.398s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:31:39 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Deleted volume successfully. Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7eddad-2f80-4684-b9b6-1173ca342ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e58d0cff-fd0d-40cd-a878-865bdc917da5', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489b3f3d-227b-4951-89f1-473acdf034bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-35f425a7-3d02-4392-a0ff-f90426fe81bb tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-9cfa3963-154d-4e01-9461-d8dff1dcbda8-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:39 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Volume volume-e58d0cff-fd0d-40cd-a878-865bdc917da5 (e58d0cff-fd0d-40cd-a878-865bdc917da5): created successfully Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489b3f3d-227b-4951-89f1-473acdf034bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Flow 'volume_create_manager' (e9d0f31a-b4f9-46a3-9bea-a25bd8703720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:31:39 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b7f21f26-fa1b-40b1-b095-199ced9392d4 tempest-AttachVolumeNegativeTest-1910161388 None] Created volume successfully. Aug 13 09:31:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-0f912c90-18c5-4d02-b7d0-d1a11b8c746b-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-0f912c90-18c5-4d02-b7d0-d1a11b8c746b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "cinder-quobyte-0f912c90-18c5-4d02-b7d0-d1a11b8c746b" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-0f912c90-18c5-4d02-b7d0-d1a11b8c746b" acquired by "delete_volume" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:40 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[740c9ebb-3544-410b-8915-a87b3dc4804b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:40 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b Aug 13 09:31:40 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:40 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b" returned: 0 in 0.659s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:41 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b Aug 13 09:31:41 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-8ea83130-3886-456c-b9d5-a94247ba7b8c req-adb2319d-83b0-4240-b353-957039c07765 tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-8ea83130-3886-456c-b9d5-a94247ba7b8c req-adb2319d-83b0-4240-b353-957039c07765 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b24c7c4-a7fc-4644-8f69-fc5006800791]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-8ea83130-3886-456c-b9d5-a94247ba7b8c req-adb2319d-83b0-4240-b353-957039c07765 tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e58d0cff-fd0d-40cd-a878-865bdc917da5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:41 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0f912c90-18c5-4d02-b7d0-d1a11b8c746b" returned: 0 in 0.414s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:41 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e58d0cff-fd0d-40cd-a878-865bdc917da5 Aug 13 09:31:41 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-quobyte-0f912c90-18c5-4d02-b7d0-d1a11b8c746b" released by "delete_volume" :: held 1.189s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Created reservations ['e1f9b177-a4c6-4f45-bddc-c4baaf63da65', '7df53dce-103e-4cd9-a9c8-973543284a79', 'e4a3c2cd-51c8-417d-8c13-034a64a6d826', 'b7a40cff-06a0-47fd-8c53-925db7979712'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:41 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-8ea83130-3886-456c-b9d5-a94247ba7b8c req-adb2319d-83b0-4240-b353-957039c07765 tempest-AttachVolumeNegativeTest-1910161388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e58d0cff-fd0d-40cd-a878-865bdc917da5" returned: 0 in 0.650s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-8ea83130-3886-456c-b9d5-a94247ba7b8c req-adb2319d-83b0-4240-b353-957039c07765 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.677s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:41 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:31:41 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-8ea83130-3886-456c-b9d5-a94247ba7b8c req-adb2319d-83b0-4240-b353-957039c07765 tempest-AttachVolumeNegativeTest-1910161388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-e58d0cff-fd0d-40cd-a878-865bdc917da5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '833910ef-b767-40a2-b895-f1800f4146d1', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:31:42 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-8ea83130-3886-456c-b9d5-a94247ba7b8c req-adb2319d-83b0-4240-b353-957039c07765 tempest-AttachVolumeNegativeTest-1910161388 None] attachment_update completed successfully. Aug 13 09:31:42 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.346s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:42 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:31:42 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Deleted volume successfully. Aug 13 09:31:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-aa9a8fbb-6c25-46f8-b155-17ee046a22e3 tempest-VolumesSnapshotTestJSON-44696910 None] Lock "cinder-0f912c90-18c5-4d02-b7d0-d1a11b8c746b-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Acquiring lock "cinder-53b598e6-2fb5-4426-91a7-333b9d19f258-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "cinder-53b598e6-2fb5-4426-91a7-333b9d19f258-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Acquiring lock "cinder-quobyte-53b598e6-2fb5-4426-91a7-333b9d19f258" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "cinder-quobyte-53b598e6-2fb5-4426-91a7-333b9d19f258" acquired by "delete_volume" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:42 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adbb818-b941-4945-b2d9-d23075b74269]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-53b598e6-2fb5-4426-91a7-333b9d19f258 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:42 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-53b598e6-2fb5-4426-91a7-333b9d19f258 Aug 13 09:31:42 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:42 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-53b598e6-2fb5-4426-91a7-333b9d19f258" returned: 0 in 0.613s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-53b598e6-2fb5-4426-91a7-333b9d19f258 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:43 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-53b598e6-2fb5-4426-91a7-333b9d19f258 Aug 13 09:31:43 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:43 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:31:43 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:43 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-53b598e6-2fb5-4426-91a7-333b9d19f258" returned: 0 in 0.409s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "cinder-quobyte-53b598e6-2fb5-4426-91a7-333b9d19f258" released by "delete_volume" :: held 1.102s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Created reservations ['73ed400e-15e3-490b-aada-e6237597408a', '8451296f-35a9-47b8-b92c-b262a4f446e5', '3bc5243a-c553-4331-a296-edf1fea42cef', '16b80364-ad95-4554-b905-6eb02e6ef176'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:31:43 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.447s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:43 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:31:43 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:44 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.280s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:44 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:31:44 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Deleted volume successfully. Aug 13 09:31:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-614211dc-0f50-4cad-abdc-221fe70eabd5 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "cinder-53b598e6-2fb5-4426-91a7-333b9d19f258-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Acquiring lock "cinder-204eacfb-7a62-40b2-8944-71d96b8c746b-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "cinder-204eacfb-7a62-40b2-8944-71d96b8c746b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Acquiring lock "cinder-quobyte-204eacfb-7a62-40b2-8944-71d96b8c746b" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:31:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "cinder-quobyte-204eacfb-7a62-40b2-8944-71d96b8c746b" acquired by "delete_volume" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:31:44 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3f63a3-f0d6-4597-a16a-6cb4ced94e89]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-204eacfb-7a62-40b2-8944-71d96b8c746b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:44 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-204eacfb-7a62-40b2-8944-71d96b8c746b Aug 13 09:31:44 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:45 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-204eacfb-7a62-40b2-8944-71d96b8c746b" returned: 0 in 0.520s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-204eacfb-7a62-40b2-8944-71d96b8c746b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:45 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-204eacfb-7a62-40b2-8944-71d96b8c746b Aug 13 09:31:45 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:45 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-2f74c0d3-c16c-4eba-9f07-57314fe7b303 req-93aa01ce-80ed-4f8d-8e33-383b25d95de2 tempest-AttachVolumeNegativeTest-1910161388 None] Terminate volume connection completed successfully. Aug 13 09:31:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-2f74c0d3-c16c-4eba-9f07-57314fe7b303 req-93aa01ce-80ed-4f8d-8e33-383b25d95de2 tempest-AttachVolumeNegativeTest-1910161388 None] Deleting attachment 833910ef-b767-40a2-b895-f1800f4146d1. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:31:45 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-204eacfb-7a62-40b2-8944-71d96b8c746b" returned: 0 in 0.409s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "cinder-quobyte-204eacfb-7a62-40b2-8944-71d96b8c746b" released by "delete_volume" :: held 0.998s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:45 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Created reservations ['98852206-1085-4728-9ade-6c51c680f13f', '8c680897-3e2e-4f6d-aa0f-259c497fb1b6', '22f16ce2-7647-4947-a0b2-4c070b55f391', '4bcf9a50-1e50-42b6-932e-a49e8b790448'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:31:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:31:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:31:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:45 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:31:45 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:46 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.324s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:46 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:31:46 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Deleted volume successfully. Aug 13 09:31:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-53518dc7-3f2d-4cf5-9dc0-95e8ade54d45 tempest-TestServerVolumeAttachmentScenario-1133447939 None] Lock "cinder-204eacfb-7a62-40b2-8944-71d96b8c746b-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Flow 'volume_create_manager' (4b1dace8-b52e-40dd-ac0d-90ef54dd44a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78841383-bc34-48d3-a3a3-1a27a5363bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78841383-bc34-48d3-a3a3-1a27a5363bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1553928369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3631cfc-4dff-485b-b083-32f469e11334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614eb47c4dbf49538c98c46c7ea0af35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:31:47Z,use_quota=True,user_id='c1da568d335c4211a26e0a44ebafa9fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2197f90-cb24-436a-b058-d1f966909b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2197f90-cb24-436a-b058-d1f966909b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d769a11-d176-4f42-a609-a0cc7e483aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d769a11-d176-4f42-a609-a0cc7e483aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3631cfc-4dff-485b-b083-32f469e11334', 'volume_name': 'volume-f3631cfc-4dff-485b-b083-32f469e11334', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ef0dd2-ec56-4058-8b58-6bfc1f5964be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ef0dd2-ec56-4058-8b58-6bfc1f5964be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c622d8a4-ebbf-4603-8bbd-5c5387e1804e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:47 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Volume f3631cfc-4dff-485b-b083-32f469e11334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3631cfc-4dff-485b-b083-32f469e11334', 'volume_size': 1} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1553928369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3631cfc-4dff-485b-b083-32f469e11334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614eb47c4dbf49538c98c46c7ea0af35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:31:47Z,use_quota=True,user_id='c1da568d335c4211a26e0a44ebafa9fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Creating volume f3631cfc-4dff-485b-b083-32f469e11334 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:31:47 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:31:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:47 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 1073741824 Aug 13 09:31:47 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:48 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 1073741824" returned: 0 in 0.591s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:48 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 Aug 13 09:31:48 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:48 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334" returned: 0 in 0.332s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:31:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:31:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c622d8a4-ebbf-4603-8bbd-5c5387e1804e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3631cfc-4dff-485b-b083-32f469e11334', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0a3e81-1f0b-4e93-bd4d-a948d10ea52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:48 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Volume volume-f3631cfc-4dff-485b-b083-32f469e11334 (f3631cfc-4dff-485b-b083-32f469e11334): created successfully Aug 13 09:31:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0a3e81-1f0b-4e93-bd4d-a948d10ea52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Flow 'volume_create_manager' (4b1dace8-b52e-40dd-ac0d-90ef54dd44a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:31:48 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c70dd520-7c02-4e10-bd45-1ddcfe3a043f tempest-TestImageHashVerification-1576269583 None] Created volume successfully. Aug 13 09:31:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:31:50 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec6713b-872a-4482-a22f-fccebd137c22]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:50 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 Aug 13 09:31:50 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:51 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334" returned: 0 in 0.487s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:51 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff5a081-6781-42f8-850c-74cb03972a19]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:51 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 Aug 13 09:31:51 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:51 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334" returned: 0 in 0.483s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 /opt/stack/data/cinder/conversion/f3631cfc-4dff-485b-b083-32f469e11334.temp_image.82b95b86-f59d-471b-8a0f-e217f3d82ee3diwip0tq.img {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:51 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 /opt/stack/data/cinder/conversion/f3631cfc-4dff-485b-b083-32f469e11334.temp_image.82b95b86-f59d-471b-8a0f-e217f3d82ee3diwip0tq.img Aug 13 09:31:51 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:31:58 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Flow 'volume_create_manager' (62a4ca40-300b-41eb-89a6-1a97ba9dda4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de5e373-a3d4-487e-a00e-63e46d8fd371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 /opt/stack/data/cinder/conversion/f3631cfc-4dff-485b-b083-32f469e11334.temp_image.82b95b86-f59d-471b-8a0f-e217f3d82ee3diwip0tq.img" returned: 0 in 6.332s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de5e373-a3d4-487e-a00e-63e46d8fd371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2022977218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c59da48-45e0-4bab-bc60-72bbef8af4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b419e13233aa420282f424718a2e62aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:31:58Z,use_quota=True,user_id='99e0641a21214225ace29f5b31bbb6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7f493c-bcd1-404d-9903-ec64f09d3dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7f493c-bcd1-404d-9903-ec64f09d3dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e01a3c-130e-4c66-89e7-47b91e02c09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e01a3c-130e-4c66-89e7-47b91e02c09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c59da48-45e0-4bab-bc60-72bbef8af4c8', 'volume_name': 'volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617c40d6-6d07-405b-92f8-f45794598d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617c40d6-6d07-405b-92f8-f45794598d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce5e966-2794-403c-b10c-1fdbfebb82c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:31:58 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Volume 7c59da48-45e0-4bab-bc60-72bbef8af4c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8', 'volume_size': 1} Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0ec069-7d41-4e04-a67d-4ec5ef6fedb0]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:31:58 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 Aug 13 09:31:58 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=57,cinder:UPDATE=64,cinder:INSERT=15,cinder:DELETE=4 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:31:58 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334" returned: 0 in 0.596s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] Image conversion details: src /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/conversion/f3631cfc-4dff-485b-b083-32f469e11334.temp_image.82b95b86-f59d-471b-8a0f-e217f3d82ee3diwip0tq.img {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:31:58 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] Converted 1024.00 MB image at 161.69 MB/s Aug 13 09:31:58 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] 82b95b86-f59d-471b-8a0f-e217f3d82ee3 was raw, no need to convert to raw {{(pid=94670) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 13 09:32:08 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:32:08 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=70,cinder:UPDATE=61,cinder:DELETE=6,cinder:INSERT=13 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:32:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.933s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] Uploaded volume to glance image-id: 82b95b86-f59d-471b-8a0f-e217f3d82ee3. {{(pid=94670) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 13 09:32:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.516s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2022977218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c59da48-45e0-4bab-bc60-72bbef8af4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b419e13233aa420282f424718a2e62aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:31:58Z,use_quota=True,user_id='99e0641a21214225ace29f5b31bbb6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:32:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Creating volume 7c59da48-45e0-4bab-bc60-72bbef8af4c8 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:32:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:32:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:32:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:32:26 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:32:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:26 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 1073741824 Aug 13 09:32:26 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c63e4ab3-e609-421c-819a-2d44748dec39 tempest-TestImageHashVerification-1576269583 None] Copy volume to image completed successfully. Aug 13 09:32:27 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 1073741824" returned: 0 in 0.500s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:27 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 Aug 13 09:32:27 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:27 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8" returned: 0 in 0.312s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:32:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Acquiring lock "cinder-f3631cfc-4dff-485b-b083-32f469e11334-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce5e966-2794-403c-b10c-1fdbfebb82c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa9ef56-678a-4c70-a9c2-2bd4c30b2c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Lock "cinder-f3631cfc-4dff-485b-b083-32f469e11334-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:27 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Volume volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 (7c59da48-45e0-4bab-bc60-72bbef8af4c8): created successfully Aug 13 09:32:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa9ef56-678a-4c70-a9c2-2bd4c30b2c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Flow 'volume_create_manager' (62a4ca40-300b-41eb-89a6-1a97ba9dda4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:32:27 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-9b4d8560-6d33-4620-a871-e658d1763121 tempest-VolumesSnapshotListTestJSON-591321264 None] Created volume successfully. Aug 13 09:32:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Acquiring lock "cinder-quobyte-f3631cfc-4dff-485b-b083-32f469e11334" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Lock "cinder-quobyte-f3631cfc-4dff-485b-b083-32f469e11334" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:27 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63a76f5-f852-4a19-b163-a24aa0b09200]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:27 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 Aug 13 09:32:27 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:28 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334" returned: 0 in 0.616s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] Creating offline snapshot d3cf692f-9413-49a3-a876-8dbb28542584 of volume 7c59da48-45e0-4bab-bc60-72bbef8af4c8 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:32:28 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334 Aug 13 09:32:28 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:28 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7716a61d-2140-4a54-a5bf-e2e896c66fdc]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:28 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 Aug 13 09:32:28 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:28 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f3631cfc-4dff-485b-b083-32f469e11334" returned: 0 in 0.459s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Lock "cinder-quobyte-f3631cfc-4dff-485b-b083-32f469e11334" released by "delete_volume" :: held 1.134s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:28 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Created reservations ['079a7ba2-a22d-4518-b8e0-00714c397599', 'bb975a26-eaed-418d-93a7-b09c89152da2', '4ac01f60-3e82-4966-b7a3-cc171e141870', 'e3ad557a-fbf0-4bd3-8ed7-cf50a60f81ac'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:32:28 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8" returned: 0 in 0.533s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:29 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 1G Aug 13 09:32:29 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:32:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:32:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:29 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:32:29 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:29 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.331s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:29 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:32:29 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Deleted volume successfully. Aug 13 09:32:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-26899e2e-3e53-451c-a0c2-5ab1892a19b9 tempest-TestImageHashVerification-1576269583 None] Lock "cinder-f3631cfc-4dff-485b-b083-32f469e11334-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:29 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 1G" returned: 0 in 0.579s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:29 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 Aug 13 09:32:29 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:29 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584" returned: 0 in 0.386s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:29 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 is being set with open permissions: ugo+rw Aug 13 09:32:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:29 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 Aug 13 09:32:29 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:30 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584" returned: 0 in 0.307s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:30 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.info Aug 13 09:32:30 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:30 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.info" returned: 0 in 0.362s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:30 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.info is being set with open permissions: ugo+rw Aug 13 09:32:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:30 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.info Aug 13 09:32:30 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:30 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.info" returned: 0 in 0.331s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.665s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:31 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5286f702-2474-462a-8f93-9cb48b131ebe tempest-VolumesSnapshotListTestJSON-591321264 None] Create snapshot completed successfully Aug 13 09:32:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b7c2c21c-10d8-4df5-8f6f-fe11cb08dd7a tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b7c2c21c-10d8-4df5-8f6f-fe11cb08dd7a tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b7c2c21c-10d8-4df5-8f6f-fe11cb08dd7a tempest-VolumesSnapshotListTestJSON-591321264 None] Creating offline snapshot 1be005cd-23fc-4fb1-bedc-4d701c6e545f of volume 7c59da48-45e0-4bab-bc60-72bbef8af4c8 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:32:31 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5123b8bf-db5a-4fbd-8a58-d77b89f458e1]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7c2c21c-10d8-4df5-8f6f-fe11cb08dd7a tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:31 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 Aug 13 09:32:31 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:32 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7c2c21c-10d8-4df5-8f6f-fe11cb08dd7a tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584" returned: 0 in 0.414s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:32 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b7c2c21c-10d8-4df5-8f6f-fe11cb08dd7a tempest-VolumesSnapshotListTestJSON-591321264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:32:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7c2c21c-10d8-4df5-8f6f-fe11cb08dd7a tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:32 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f 1G Aug 13 09:32:32 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:32 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7c2c21c-10d8-4df5-8f6f-fe11cb08dd7a tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f 1G" returned: 0 in 0.684s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7c2c21c-10d8-4df5-8f6f-fe11cb08dd7a tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:32 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f Aug 13 09:32:32 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Flow 'volume_create_manager' (ce8f1840-9948-4c9c-878c-d8bae777989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be17fe3e-bac9-4b71-bbdd-4621164c06c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be17fe3e-bac9-4b71-bbdd-4621164c06c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-334766333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458402f9-d66d-4f82-acd3-edf7465558b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87add6622ea430ea7954ec9756993dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:32:33Z,use_quota=True,user_id='a38f1dfac54e4411a17ec5b029e6ef20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40525c4-9ea0-4da1-85ec-264f28fc4746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40525c4-9ea0-4da1-85ec-264f28fc4746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f980443-c041-429d-b80e-b3306831de43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f980443-c041-429d-b80e-b3306831de43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '458402f9-d66d-4f82-acd3-edf7465558b8', 'volume_name': 'volume-458402f9-d66d-4f82-acd3-edf7465558b8', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac614664-3f2c-436d-9f63-0ffc58904e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac614664-3f2c-436d-9f63-0ffc58904e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd8292b-5ec9-4c86-bf87-f00992fcf881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:33 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Volume 458402f9-d66d-4f82-acd3-edf7465558b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-458402f9-d66d-4f82-acd3-edf7465558b8', 'volume_size': 1} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:33 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7c2c21c-10d8-4df5-8f6f-fe11cb08dd7a tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f" returned: 0 in 0.386s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:33 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-b7c2c21c-10d8-4df5-8f6f-fe11cb08dd7a tempest-VolumesSnapshotListTestJSON-591321264 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f is being set with open permissions: ugo+rw Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7c2c21c-10d8-4df5-8f6f-fe11cb08dd7a tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:33 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f Aug 13 09:32:33 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:33 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7c2c21c-10d8-4df5-8f6f-fe11cb08dd7a tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f" returned: 0 in 0.274s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b7c2c21c-10d8-4df5-8f6f-fe11cb08dd7a tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.884s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.442s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-334766333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458402f9-d66d-4f82-acd3-edf7465558b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87add6622ea430ea7954ec9756993dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:32:33Z,use_quota=True,user_id='a38f1dfac54e4411a17ec5b029e6ef20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Creating volume 458402f9-d66d-4f82-acd3-edf7465558b8 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:32:33 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:32:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-458402f9-d66d-4f82-acd3-edf7465558b8 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:33 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-458402f9-d66d-4f82-acd3-edf7465558b8 1073741824 Aug 13 09:32:33 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:33 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b7c2c21c-10d8-4df5-8f6f-fe11cb08dd7a tempest-VolumesSnapshotListTestJSON-591321264 None] Create snapshot completed successfully Aug 13 09:32:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-17875384-9b81-408a-95a8-40ed663b2096 tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:34 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-458402f9-d66d-4f82-acd3-edf7465558b8 1073741824" returned: 0 in 0.636s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-458402f9-d66d-4f82-acd3-edf7465558b8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:34 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-458402f9-d66d-4f82-acd3-edf7465558b8 Aug 13 09:32:34 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:34 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-458402f9-d66d-4f82-acd3-edf7465558b8" returned: 0 in 0.318s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:32:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-17875384-9b81-408a-95a8-40ed663b2096 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.561s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd8292b-5ec9-4c86-bf87-f00992fcf881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-458402f9-d66d-4f82-acd3-edf7465558b8', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b718b17c-945a-412a-b038-1a504d40ac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-17875384-9b81-408a-95a8-40ed663b2096 tempest-VolumesSnapshotListTestJSON-591321264 None] Creating offline snapshot 3f559c2a-a83b-4a24-8e93-acc4810f8830 of volume 7c59da48-45e0-4bab-bc60-72bbef8af4c8 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:32:34 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Volume volume-458402f9-d66d-4f82-acd3-edf7465558b8 (458402f9-d66d-4f82-acd3-edf7465558b8): created successfully Aug 13 09:32:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b718b17c-945a-412a-b038-1a504d40ac66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Flow 'volume_create_manager' (ce8f1840-9948-4c9c-878c-d8bae777989c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:32:34 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f4b915-e370-46ae-9f8a-3700b2fd23f4]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17875384-9b81-408a-95a8-40ed663b2096 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:34 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-7b5be8c2-0dc4-45c1-a606-4fa789978923 tempest-AttachVolumeNegativeTest-1910161388 None] Created volume successfully. Aug 13 09:32:34 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f Aug 13 09:32:34 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:35 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17875384-9b81-408a-95a8-40ed663b2096 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f" returned: 0 in 0.484s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-17875384-9b81-408a-95a8-40ed663b2096 tempest-VolumesSnapshotListTestJSON-591321264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:32:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17875384-9b81-408a-95a8-40ed663b2096 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:35 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830 1G Aug 13 09:32:35 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:36 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17875384-9b81-408a-95a8-40ed663b2096 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830 1G" returned: 0 in 0.811s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17875384-9b81-408a-95a8-40ed663b2096 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:36 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830 Aug 13 09:32:36 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-39d5ea6e-dfe8-49de-b775-988578553b2c req-23b27bb0-4180-4dd0-9d54-e06b883e137d tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:36 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17875384-9b81-408a-95a8-40ed663b2096 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830" returned: 0 in 0.406s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:36 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-17875384-9b81-408a-95a8-40ed663b2096 tempest-VolumesSnapshotListTestJSON-591321264 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830 is being set with open permissions: ugo+rw Aug 13 09:32:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17875384-9b81-408a-95a8-40ed663b2096 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:36 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830 Aug 13 09:32:36 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:36 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17875384-9b81-408a-95a8-40ed663b2096 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830" returned: 0 in 0.287s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-17875384-9b81-408a-95a8-40ed663b2096 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-39d5ea6e-dfe8-49de-b775-988578553b2c req-23b27bb0-4180-4dd0-9d54-e06b883e137d tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.626s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:36 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[834b1599-03cb-4dc5-8fa1-04ea644558f9]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-39d5ea6e-dfe8-49de-b775-988578553b2c req-23b27bb0-4180-4dd0-9d54-e06b883e137d tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-458402f9-d66d-4f82-acd3-edf7465558b8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:36 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-17875384-9b81-408a-95a8-40ed663b2096 tempest-VolumesSnapshotListTestJSON-591321264 None] Create snapshot completed successfully Aug 13 09:32:37 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-458402f9-d66d-4f82-acd3-edf7465558b8 Aug 13 09:32:37 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:37 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-39d5ea6e-dfe8-49de-b775-988578553b2c req-23b27bb0-4180-4dd0-9d54-e06b883e137d tempest-AttachVolumeNegativeTest-1910161388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-458402f9-d66d-4f82-acd3-edf7465558b8" returned: 0 in 0.499s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-39d5ea6e-dfe8-49de-b775-988578553b2c req-23b27bb0-4180-4dd0-9d54-e06b883e137d tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.532s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-39d5ea6e-dfe8-49de-b775-988578553b2c req-23b27bb0-4180-4dd0-9d54-e06b883e137d tempest-AttachVolumeNegativeTest-1910161388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-458402f9-d66d-4f82-acd3-edf7465558b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50ef9d10-644a-4d99-903d-2717b96b1e5b', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:32:37 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-39d5ea6e-dfe8-49de-b775-988578553b2c req-23b27bb0-4180-4dd0-9d54-e06b883e137d tempest-AttachVolumeNegativeTest-1910161388 None] attachment_update completed successfully. Aug 13 09:32:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "cinder-3f559c2a-a83b-4a24-8e93-acc4810f8830-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-3f559c2a-a83b-4a24-8e93-acc4810f8830-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "cinder-quobyte-7c59da48-45e0-4bab-bc60-72bbef8af4c8" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-quobyte-7c59da48-45e0-4bab-bc60-72bbef8af4c8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "cinder-quobyte-3f559c2a-a83b-4a24-8e93-acc4810f8830" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-quobyte-3f559c2a-a83b-4a24-8e93-acc4810f8830" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Deleting offline snapshot 3f559c2a-a83b-4a24-8e93-acc4810f8830 of volume 7c59da48-45e0-4bab-bc60-72bbef8af4c8 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:32:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] snapshot_file for this snap is: volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:32:38 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c82387-07f8-4563-8894-0096314f0aa2]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:38 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830 Aug 13 09:32:38 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:39 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830" returned: 0 in 0.468s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:32:39 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0702aa7-781a-4488-a959-d485f59be5cc]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:39 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f Aug 13 09:32:39 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:39 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f" returned: 0 in 0.527s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:32:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:39 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830 Aug 13 09:32:39 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:40 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830" returned: 0 in 0.470s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:40 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830 Aug 13 09:32:40 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:40 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-d645a661-8d01-4fd2-a893-2ac35ef16dc7 req-14258f7b-1dc0-4daa-8ed7-81569d8a0c21 tempest-AttachVolumeNegativeTest-1910161388 None] Terminate volume connection completed successfully. Aug 13 09:32:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d645a661-8d01-4fd2-a893-2ac35ef16dc7 req-14258f7b-1dc0-4daa-8ed7-81569d8a0c21 tempest-AttachVolumeNegativeTest-1910161388 None] Deleting attachment 50ef9d10-644a-4d99-903d-2717b96b1e5b. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:32:40 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.3f559c2a-a83b-4a24-8e93-acc4810f8830" returned: 0 in 0.397s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-quobyte-3f559c2a-a83b-4a24-8e93-acc4810f8830" released by "_delete_snapshot" :: held 2.016s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-quobyte-7c59da48-45e0-4bab-bc60-72bbef8af4c8" released by "delete_snapshot" :: held 2.054s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:40 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Created reservations ['d3fa9a4d-a8a8-496f-a76b-1f237f6549a5', '19bf091a-5f5d-4f77-a7ec-46b4598b7afb', 'a1fbab5a-91c0-4bbc-abec-82782c2577dc', 'cc9aa8c7-63c5-4005-877d-71b29db9ee8b'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:32:41 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:32:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Flow 'volume_create_manager' (f0c0851d-9c1b-4a14-bea8-49cca31ada99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:32:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070a5536-22d6-4d72-9265-53a1399f77c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070a5536-22d6-4d72-9265-53a1399f77c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-504823841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e583c4324e0141e1832602950ee3ddff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:32:41Z,use_quota=True,user_id='5f1a2045bd7d4da6bce8daf52cad6da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab37405-f7d3-4c17-b2c3-77a5dbbf6751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab37405-f7d3-4c17-b2c3-77a5dbbf6751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c4a7f2-1aad-4ac7-9259-5835a49230d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:41 devstack cinder-volume[94670]: DEBUG cinder.image.glance [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Creating Keystone auth plugin from conf {{(pid=94670) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 13 09:32:41 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Delete snapshot completed successfully. Aug 13 09:32:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-352d8dd3-df9d-4538-b8e1-ad172f5364af tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-3f559c2a-a83b-4a24-8e93-acc4810f8830-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c4a7f2-1aad-4ac7-9259-5835a49230d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0', 'volume_name': 'volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0', 'volume_size': 1, 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3c2349994ac4b0198f93975c909efdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'created_at': datetime.datetime(2026, 8, 13, 7, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 15, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1330bb5-9d27-4913-888d-485e4ed28bd9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1935fdec-4eeb-4a1e-a73d-0d54a99f073f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1935fdec-4eeb-4a1e-a73d-0d54a99f073f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd29b85-aa3a-4316-82fa-9418a092974e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:41 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Volume 49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0', 'volume_size': 1, 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3c2349994ac4b0198f93975c909efdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'created_at': datetime.datetime(2026, 8, 13, 7, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 15, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1330bb5-9d27-4913-888d-485e4ed28bd9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 13 09:32:41 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Trying to clone 49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 from image b1330bb5-9d27-4913-888d-485e4ed28bd9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]). {{(pid=94670) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_wcqhdzahdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 13 09:32:42 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Image download 20.69 MB at 20.69 MB/s Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa74ed7-69f8-4b26-93db-6b4321330b7a]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "cinder-1be005cd-23fc-4fb1-bedc-4d701c6e545f-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_wcqhdzahdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-1be005cd-23fc-4fb1-bedc-4d701c6e545f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "cinder-quobyte-7c59da48-45e0-4bab-bc60-72bbef8af4c8" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-quobyte-7c59da48-45e0-4bab-bc60-72bbef8af4c8" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "cinder-quobyte-1be005cd-23fc-4fb1-bedc-4d701c6e545f" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-quobyte-1be005cd-23fc-4fb1-bedc-4d701c6e545f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Deleting offline snapshot 1be005cd-23fc-4fb1-bedc-4d701c6e545f of volume 7c59da48-45e0-4bab-bc60-72bbef8af4c8 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] snapshot_file for this snap is: volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:32:42 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_wcqhdzahdevstack@QuobyteHD Aug 13 09:32:42 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[102cdc15-c51d-4cce-bb8d-dfd1229e5c1d]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:42 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f Aug 13 09:32:42 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:42 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_wcqhdzahdevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Temporary image b1330bb5-9d27-4913-888d-485e4ed28bd9 is fetched for user 5f1a2045bd7d4da6bce8daf52cad6da2. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d96cf3-2d00-4384-81fa-6cc2bd383c19]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_wcqhdzahdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:42 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_wcqhdzahdevstack@QuobyteHD Aug 13 09:32:42 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:43 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f" returned: 0 in 0.809s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecacdce6-0c44-4584-adf0-11edac8d1966]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:43 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:32:43 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:43 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_wcqhdzahdevstack@QuobyteHD" returned: 0 in 0.614s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-504823841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e583c4324e0141e1832602950ee3ddff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:32:41Z,use_quota=True,user_id='5f1a2045bd7d4da6bce8daf52cad6da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Creating volume 49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:32:43 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:43 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 Aug 13 09:32:43 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:43 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 1073741824 Aug 13 09:32:43 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:43 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.549s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:32:43 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584" returned: 0 in 0.727s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:32:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:43 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f Aug 13 09:32:43 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:44 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 1073741824" returned: 0 in 0.900s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:44 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 Aug 13 09:32:44 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:44 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f" returned: 0 in 0.584s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:44 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f Aug 13 09:32:44 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:44 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0" returned: 0 in 0.431s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:32:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:44 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Attempting download of b1330bb5-9d27-4913-888d-485e4ed28bd9 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}])) to volume 49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 13 09:32:44 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.1be005cd-23fc-4fb1-bedc-4d701c6e545f" returned: 0 in 0.422s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-quobyte-1be005cd-23fc-4fb1-bedc-4d701c6e545f" released by "_delete_snapshot" :: held 2.724s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:44 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f908051-b5e3-4d56-880d-73a902eb4acb]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_9wmfu2c8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-quobyte-7c59da48-45e0-4bab-bc60-72bbef8af4c8" released by "delete_snapshot" :: held 2.767s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:45 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Created reservations ['dec96b1c-0e48-416b-ae9c-341b7fe7ab02', '2a597cb0-3555-4ae1-8da4-55667b6d2ce1', 'cae2c960-5c5a-4d77-a8b4-2e31e19fc6de', '3b93cf85-a349-4a9d-ba49-53dd08b1b1ab'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:32:45 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_9wmfu2c8 Aug 13 09:32:45 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:45 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Delete snapshot completed successfully. Aug 13 09:32:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-984686b4-16d5-4b1f-adbe-7d3822032fb2 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-1be005cd-23fc-4fb1-bedc-4d701c6e545f-delete_snapshot" released by "delete_snapshot" :: held 2.998s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "cinder-d3cf692f-9413-49a3-a876-8dbb28542584-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-d3cf692f-9413-49a3-a876-8dbb28542584-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "cinder-quobyte-7c59da48-45e0-4bab-bc60-72bbef8af4c8" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-quobyte-7c59da48-45e0-4bab-bc60-72bbef8af4c8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "cinder-quobyte-d3cf692f-9413-49a3-a876-8dbb28542584" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-quobyte-d3cf692f-9413-49a3-a876-8dbb28542584" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:45 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Deleting offline snapshot d3cf692f-9413-49a3-a876-8dbb28542584 of volume 7c59da48-45e0-4bab-bc60-72bbef8af4c8 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:32:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] snapshot_file for this snap is: volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:32:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_9wmfu2c8" returned: 0 in 0.580s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_9wmfu2c8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:45 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df8c83f-83d9-497f-94d7-eaad6cf5dd0e]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:45 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_9wmfu2c8 Aug 13 09:32:45 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:45 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 Aug 13 09:32:45 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:46 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584" returned: 0 in 0.463s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:32:46 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_9wmfu2c8" returned: 1 in 0.525s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1330bb5-9d27-4913-888d-485e4ed28bd9_9wmfu2c8' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af4e40f-29f2-45a0-875d-c1e825d59540]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_wcqhdzahdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8b71f6-3bae-4017-b8af-4eb2a4d84ea4]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:46 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_wcqhdzahdevstack@QuobyteHD Aug 13 09:32:46 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "cinder-458402f9-d66d-4f82-acd3-edf7465558b8-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:46 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 Aug 13 09:32:46 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "cinder-458402f9-d66d-4f82-acd3-edf7465558b8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "cinder-quobyte-458402f9-d66d-4f82-acd3-edf7465558b8" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "cinder-quobyte-458402f9-d66d-4f82-acd3-edf7465558b8" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfcfc8e-1239-4914-b212-988ec7a73d00]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-458402f9-d66d-4f82-acd3-edf7465558b8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:46 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_wcqhdzahdevstack@QuobyteHD" returned: 0 in 0.512s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] b1330bb5-9d27-4913-888d-485e4ed28bd9 was qcow2, converting to raw {{(pid=94670) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_wcqhdzahdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:46 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-458402f9-d66d-4f82-acd3-edf7465558b8 Aug 13 09:32:46 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:46 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_wcqhdzahdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 Aug 13 09:32:46 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:46 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8" returned: 0 in 0.639s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:46 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 Aug 13 09:32:46 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:46 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-458402f9-d66d-4f82-acd3-edf7465558b8" returned: 0 in 0.508s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-458402f9-d66d-4f82-acd3-edf7465558b8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:46 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-458402f9-d66d-4f82-acd3-edf7465558b8 Aug 13 09:32:46 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:47 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584" returned: 0 in 0.449s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:47 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584 Aug 13 09:32:47 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:47 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-458402f9-d66d-4f82-acd3-edf7465558b8" returned: 0 in 0.334s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "cinder-quobyte-458402f9-d66d-4f82-acd3-edf7465558b8" released by "delete_volume" :: held 0.910s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Created reservations ['c28f8159-1257-4aa7-b6a9-545b9cee54c4', '92745b25-79f6-483f-8c49-8bb6b46e3ef4', '518e9e8c-757b-4d45-91fd-a75bbe373438', 'f4af6865-efae-4523-a860-206fd28844e4'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:47 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:32:47 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:47 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8.d3cf692f-9413-49a3-a876-8dbb28542584" returned: 0 in 0.506s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "cinder-e58d0cff-fd0d-40cd-a878-865bdc917da5-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Lock "cinder-e58d0cff-fd0d-40cd-a878-865bdc917da5-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-quobyte-d3cf692f-9413-49a3-a876-8dbb28542584" released by "_delete_snapshot" :: held 2.290s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-quobyte-7c59da48-45e0-4bab-bc60-72bbef8af4c8" released by "delete_snapshot" :: held 2.362s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "cinder-quobyte-e58d0cff-fd0d-40cd-a878-865bdc917da5" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:47 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.402s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Lock "cinder-quobyte-e58d0cff-fd0d-40cd-a878-865bdc917da5" acquired by "delete_volume" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:47 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Deleted volume successfully. Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ff6db5-af0f-42e4-bd43-3bcee4bb3592]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e58d0cff-fd0d-40cd-a878-865bdc917da5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-938caee7-c025-41a4-854f-32cea44ae060 tempest-AttachVolumeNegativeTest-1910161388 None] Lock "cinder-458402f9-d66d-4f82-acd3-edf7465558b8-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:47 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Created reservations ['bf114693-90db-42bf-af8b-6729855de015', 'abda7d45-a373-4204-b93e-27edb6c50533', '48da3bd3-22ef-4957-8072-76e6ecbaca81', '146157b0-6af5-46c1-b9d7-51154a1c7356'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:32:48 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Delete snapshot completed successfully. Aug 13 09:32:48 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e58d0cff-fd0d-40cd-a878-865bdc917da5 Aug 13 09:32:48 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-20cd510a-281b-420f-a2c8-9d2d1eba67b7 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-d3cf692f-9413-49a3-a876-8dbb28542584-delete_snapshot" released by "delete_snapshot" :: held 2.700s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:48 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e58d0cff-fd0d-40cd-a878-865bdc917da5" returned: 0 in 0.500s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e58d0cff-fd0d-40cd-a878-865bdc917da5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:32:48 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e58d0cff-fd0d-40cd-a878-865bdc917da5 Aug 13 09:32:48 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Flow 'volume_create_manager' (2f2907c7-5f86-4f75-8f19-9aa6e053e00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2d19c1-217f-48e8-ba0b-30a04c1ddabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2d19c1-217f-48e8-ba0b-30a04c1ddabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d7c7fd-d835-4314-a376-9e3c70c846cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a06dc69d88244108b79cf1e09d82983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:32:48Z,use_quota=True,user_id='73980a4d7cfe49379e0d1dc337499afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d467e04-570c-48fb-b443-3ec47be73e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d467e04-570c-48fb-b443-3ec47be73e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b4f017-369f-401d-b385-e3ec0258bf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b4f017-369f-401d-b385-e3ec0258bf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d7c7fd-d835-4314-a376-9e3c70c846cd', 'volume_name': 'volume-01d7c7fd-d835-4314-a376-9e3c70c846cd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94dc25f1-a67f-45a9-a577-0641aaa0c409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94dc25f1-a67f-45a9-a577-0641aaa0c409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29546229-6665-488f-b16a-7fe8e4d78aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:48 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Volume 01d7c7fd-d835-4314-a376-9e3c70c846cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d7c7fd-d835-4314-a376-9e3c70c846cd', 'volume_size': 1} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d7c7fd-d835-4314-a376-9e3c70c846cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a06dc69d88244108b79cf1e09d82983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:32:48Z,use_quota=True,user_id='73980a4d7cfe49379e0d1dc337499afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Creating volume 01d7c7fd-d835-4314-a376-9e3c70c846cd {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:32:48 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-01d7c7fd-d835-4314-a376-9e3c70c846cd 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:48 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-01d7c7fd-d835-4314-a376-9e3c70c846cd 1073741824 Aug 13 09:32:48 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:48 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_wcqhdzahdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0" returned: 0 in 2.155s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b1330bb5-9d27-4913-888d-485e4ed28bd9_wcqhdzahdevstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:32:48 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Converted 112.00 MB image at 51.95 MB/s Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:48 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 1G Aug 13 09:32:48 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:48 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "cinder-7c59da48-45e0-4bab-bc60-72bbef8af4c8-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e58d0cff-fd0d-40cd-a878-865bdc917da5" returned: 0 in 0.407s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-7c59da48-45e0-4bab-bc60-72bbef8af4c8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Lock "cinder-quobyte-e58d0cff-fd0d-40cd-a878-865bdc917da5" released by "delete_volume" :: held 0.990s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "cinder-quobyte-7c59da48-45e0-4bab-bc60-72bbef8af4c8" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-quobyte-7c59da48-45e0-4bab-bc60-72bbef8af4c8" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:48 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Created reservations ['f5fd5404-cd66-420d-8144-5a8cf89a1137', 'fda4643c-7496-451e-aedc-4aca8b9ea93b', '532e718e-99d2-497e-9a7c-0c321db8c549', '9fcf9c1a-bf6f-4d59-bd3d-30c1d17a3f77'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b516bf-4548-4f07-a5ba-7b4ceb5b0af7]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:49 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 1G" returned: 0 in 0.394s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:49 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:32:49 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:49 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 Aug 13 09:32:49 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefc2cfa-f7d9-4029-bfbc-b61f12037c7a]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:49 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-01d7c7fd-d835-4314-a376-9e3c70c846cd 1073741824" returned: 0 in 0.599s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-01d7c7fd-d835-4314-a376-9e3c70c846cd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:49 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-01d7c7fd-d835-4314-a376-9e3c70c846cd Aug 13 09:32:49 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:49 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 Aug 13 09:32:49 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:49 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.357s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:32:49 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Deleted volume successfully. Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-aec4738e-0809-4ecd-b07d-08eb3881e83e tempest-AttachVolumeNegativeTest-1910161388 None] Lock "cinder-e58d0cff-fd0d-40cd-a878-865bdc917da5-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:49 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8" returned: 0 in 0.603s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:49 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-01d7c7fd-d835-4314-a376-9e3c70c846cd" returned: 0 in 0.375s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:49 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8 Aug 13 09:32:49 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29546229-6665-488f-b16a-7fe8e4d78aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d7c7fd-d835-4314-a376-9e3c70c846cd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:49 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55024565-13e8-44a3-bea9-bcc4a653af1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0" returned: 0 in 0.493s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:49 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Volume volume-01d7c7fd-d835-4314-a376-9e3c70c846cd (01d7c7fd-d835-4314-a376-9e3c70c846cd): created successfully Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55024565-13e8-44a3-bea9-bcc4a653af1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Flow 'volume_create_manager' (2f2907c7-5f86-4f75-8f19-9aa6e053e00c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:32:49 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-898a48bc-6889-4e06-b135-6904b58ad6eb tempest-CinderUnicodeTest-728735239 None] Created volume successfully. Aug 13 09:32:49 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 Aug 13 09:32:49 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:49 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7c59da48-45e0-4bab-bc60-72bbef8af4c8" returned: 0 in 0.328s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-quobyte-7c59da48-45e0-4bab-bc60-72bbef8af4c8" released by "delete_volume" :: held 1.012s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Created reservations ['c9f55275-7f5d-49c2-8acd-64f169057a52', '105919d0-d738-4d38-b552-0c0be8f0279b', 'd7efaf70-a0a3-42da-81d8-45cab96574e5', 'c602aa10-b712-4454-9023-0ec7d789468b'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:50 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0" returned: 1 in 0.436s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Downloaded image b1330bb5-9d27-4913-888d-485e4ed28bd9 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}])) to volume 49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 successfully. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Temporary image b1330bb5-9d27-4913-888d-485e4ed28bd9 for user 5f1a2045bd7d4da6bce8daf52cad6da2 is deleted. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Marking volume 49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 as bootable. {{(pid=94670) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 13 09:32:50 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:32:50 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Copying metadata from image b1330bb5-9d27-4913-888d-485e4ed28bd9 to 49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0. {{(pid=94670) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Creating volume glance metadata for volume 49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 backed by image b1330bb5-9d27-4913-888d-485e4ed28bd9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94670) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "cinder-8e7298f9-246f-43fb-a2eb-371799068b63-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Lock "cinder-8e7298f9-246f-43fb-a2eb-371799068b63-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd29b85-aa3a-4316-82fa-9418a092974e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0', 'volume_size': 1, 'image_id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1330bb5-9d27-4913-888d-485e4ed28bd9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b3c2349994ac4b0198f93975c909efdd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1330bb5-9d27-4913-888d-485e4ed28bd9', 'created_at': datetime.datetime(2026, 8, 13, 7, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 15, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1330bb5-9d27-4913-888d-485e4ed28bd9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788197d6-bf7c-4340-989f-e9d650d0268b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:50 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Volume volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 (49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0): created successfully Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788197d6-bf7c-4340-989f-e9d650d0268b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Flow 'volume_create_manager' (f0c0851d-9c1b-4a14-bea8-49cca31ada99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "cinder-quobyte-8e7298f9-246f-43fb-a2eb-371799068b63" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:50 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6dfbdf7c-92ed-4ee4-91e5-0476e66ed31e tempest-TestShelveInstance-59204464 None] Created volume successfully. Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Lock "cinder-quobyte-8e7298f9-246f-43fb-a2eb-371799068b63" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84e7fc1-0fbf-4511-8211-6e01bb4230ce]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8e7298f9-246f-43fb-a2eb-371799068b63 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:50 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.274s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:32:50 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Deleted volume successfully. Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4b844710-33a3-4dd2-8997-0816598a5de2 tempest-VolumesSnapshotListTestJSON-591321264 None] Lock "cinder-7c59da48-45e0-4bab-bc60-72bbef8af4c8-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:50 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8e7298f9-246f-43fb-a2eb-371799068b63 Aug 13 09:32:50 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:50 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8e7298f9-246f-43fb-a2eb-371799068b63" returned: 0 in 0.395s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8e7298f9-246f-43fb-a2eb-371799068b63 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:50 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8e7298f9-246f-43fb-a2eb-371799068b63 Aug 13 09:32:50 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:51 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8e7298f9-246f-43fb-a2eb-371799068b63" returned: 0 in 0.315s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Lock "cinder-quobyte-8e7298f9-246f-43fb-a2eb-371799068b63" released by "delete_volume" :: held 0.756s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Created reservations ['d1212dff-2b1d-41a9-9a5d-712ca4a5ecea', '0a5c2a98-f8ba-4ae2-bf29-a9a650fa783c', 'faf28a5f-6b46-4042-9ac6-66bdd0086c55', '72d4399c-037c-4cb6-a179-c60e21f4e6f4'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Flow 'volume_create_manager' (15cbf2db-ecd7-4644-aefe-bbc695766e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9fc317-f925-4588-bb36-e2e7dae78f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9fc317-f925-4588-bb36-e2e7dae78f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:32:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1288492214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889cee90-342f-41b3-9be8-8f9206bf1b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a06dc69d88244108b79cf1e09d82983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:32:51Z,use_quota=True,user_id='73980a4d7cfe49379e0d1dc337499afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f65726b-bafa-45c4-b798-977f8ad5b69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f65726b-bafa-45c4-b798-977f8ad5b69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0579e9f7-04e8-4e8b-970a-6f5fb81ad791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0579e9f7-04e8-4e8b-970a-6f5fb81ad791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '889cee90-342f-41b3-9be8-8f9206bf1b20', 'volume_name': 'volume-889cee90-342f-41b3-9be8-8f9206bf1b20', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae36db5-0d38-41c8-9d9a-0f25b2f9d43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae36db5-0d38-41c8-9d9a-0f25b2f9d43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0b0d0c-fdd0-4005-bc8d-cff1c710a718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:51 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Volume 889cee90-342f-41b3-9be8-8f9206bf1b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-889cee90-342f-41b3-9be8-8f9206bf1b20', 'volume_size': 1} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:32:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1288492214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889cee90-342f-41b3-9be8-8f9206bf1b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a06dc69d88244108b79cf1e09d82983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:32:51Z,use_quota=True,user_id='73980a4d7cfe49379e0d1dc337499afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Creating volume 889cee90-342f-41b3-9be8-8f9206bf1b20 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:32:51 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:51 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20 1073741824 Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:51 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:51 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:32:51 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:51 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.417s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:32:51 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Deleted volume successfully. Aug 13 09:32:51 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5d57ee62-1a10-4d4e-b425-a8345b6889cd tempest-AttachVolumeNegativeTest-1910161388 None] Lock "cinder-8e7298f9-246f-43fb-a2eb-371799068b63-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:52 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20 1073741824" returned: 0 in 0.721s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:52 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20 Aug 13 09:32:52 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:52 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20" returned: 0 in 0.360s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:32:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0b0d0c-fdd0-4005-bc8d-cff1c710a718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-889cee90-342f-41b3-9be8-8f9206bf1b20', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c3e535-09cf-4cd2-ad9c-400d5069239a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:32:52 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Volume volume-889cee90-342f-41b3-9be8-8f9206bf1b20 (889cee90-342f-41b3-9be8-8f9206bf1b20): created successfully Aug 13 09:32:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c3e535-09cf-4cd2-ad9c-400d5069239a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:32:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Flow 'volume_create_manager' (15cbf2db-ecd7-4644-aefe-bbc695766e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:32:52 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e8243198-769e-41ad-b5ad-be0fa069dc0f tempest-CinderUnicodeTest-728735239 None] Created volume successfully. Aug 13 09:32:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] Creating offline snapshot c241de52-6854-4e62-a6f1-cda129dbdada of volume 889cee90-342f-41b3-9be8-8f9206bf1b20 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:32:54 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e4e3b3-6516-4c65-a38d-56f7c06c2056]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:54 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20 Aug 13 09:32:54 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:54 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20" returned: 0 in 0.632s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:54 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada 1G Aug 13 09:32:54 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-bf7eeabe-55ae-4f56-810f-784c2fcb66e9 req-11fa861d-32e0-45eb-b662-35ac89a712c2 tempest-TestShelveInstance-59204464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:32:55 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada 1G" returned: 0 in 0.594s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-889cee90-342f-41b3-9be8-8f9206bf1b20 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:55 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-889cee90-342f-41b3-9be8-8f9206bf1b20 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada Aug 13 09:32:55 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:55 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-889cee90-342f-41b3-9be8-8f9206bf1b20 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada" returned: 0 in 0.423s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:55 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada is being set with open permissions: ugo+rw Aug 13 09:32:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:55 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada Aug 13 09:32:55 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:56 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada" returned: 0 in 0.323s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:56 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.info Aug 13 09:32:56 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:56 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.info" returned: 0 in 0.279s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:56 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.info is being set with open permissions: ugo+rw Aug 13 09:32:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:56 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.info Aug 13 09:32:56 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:56 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.info" returned: 0 in 0.364s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.748s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-bf7eeabe-55ae-4f56-810f-784c2fcb66e9 req-11fa861d-32e0-45eb-b662-35ac89a712c2 tempest-TestShelveInstance-59204464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.834s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:32:56 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3b82e65b-8848-4a23-9c12-f9d7e76cd89b tempest-CinderUnicodeTest-728735239 None] Create snapshot completed successfully Aug 13 09:32:56 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c360824-56b5-4409-ada5-99a8e057dc58]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-bf7eeabe-55ae-4f56-810f-784c2fcb66e9 req-11fa861d-32e0-45eb-b662-35ac89a712c2 tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:56 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 Aug 13 09:32:56 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Acquiring lock "cinder-c241de52-6854-4e62-a6f1-cda129dbdada-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Lock "cinder-c241de52-6854-4e62-a6f1-cda129dbdada-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Acquiring lock "cinder-quobyte-889cee90-342f-41b3-9be8-8f9206bf1b20" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Lock "cinder-quobyte-889cee90-342f-41b3-9be8-8f9206bf1b20" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Acquiring lock "cinder-quobyte-c241de52-6854-4e62-a6f1-cda129dbdada" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Lock "cinder-quobyte-c241de52-6854-4e62-a6f1-cda129dbdada" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Deleting offline snapshot c241de52-6854-4e62-a6f1-cda129dbdada of volume 889cee90-342f-41b3-9be8-8f9206bf1b20 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] snapshot_file for this snap is: volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:32:57 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-bf7eeabe-55ae-4f56-810f-784c2fcb66e9 req-11fa861d-32e0-45eb-b662-35ac89a712c2 tempest-TestShelveInstance-59204464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0" returned: 0 in 0.560s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-bf7eeabe-55ae-4f56-810f-784c2fcb66e9 req-11fa861d-32e0-45eb-b662-35ac89a712c2 tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e1fdeb-4896-4a72-8bfe-ed66c091f429]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:57 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada Aug 13 09:32:57 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:57 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 Aug 13 09:32:57 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:57 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada" returned: 0 in 0.502s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-889cee90-342f-41b3-9be8-8f9206bf1b20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:32:57 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-bf7eeabe-55ae-4f56-810f-784c2fcb66e9 req-11fa861d-32e0-45eb-b662-35ac89a712c2 tempest-TestShelveInstance-59204464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0" returned: 1 in 0.568s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-bf7eeabe-55ae-4f56-810f-784c2fcb66e9 req-11fa861d-32e0-45eb-b662-35ac89a712c2 tempest-TestShelveInstance-59204464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-bf7eeabe-55ae-4f56-810f-784c2fcb66e9 req-11fa861d-32e0-45eb-b662-35ac89a712c2 tempest-TestShelveInstance-59204464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.202s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a75dd6b-f873-4324-9c54-c429edcfaaa3]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:32:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-bf7eeabe-55ae-4f56-810f-784c2fcb66e9 req-11fa861d-32e0-45eb-b662-35ac89a712c2 tempest-TestShelveInstance-59204464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cf22b29-5db8-4ea4-a430-f18d4929f863', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:32:58 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-bf7eeabe-55ae-4f56-810f-784c2fcb66e9 req-11fa861d-32e0-45eb-b662-35ac89a712c2 tempest-TestShelveInstance-59204464 None] attachment_update completed successfully. Aug 13 09:32:58 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20 Aug 13 09:32:58 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:58 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20" returned: 0 in 0.581s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:58 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada Aug 13 09:32:58 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:58 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada" returned: 0 in 0.419s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:32:59 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada Aug 13 09:32:59 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:32:59 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Aug 13 09:32:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20.c241de52-6854-4e62-a6f1-cda129dbdada" returned: 0 in 0.386s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:32:59 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Lock "cinder-quobyte-c241de52-6854-4e62-a6f1-cda129dbdada" released by "_delete_snapshot" :: held 2.118s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:59 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Lock "cinder-quobyte-889cee90-342f-41b3-9be8-8f9206bf1b20" released by "delete_snapshot" :: held 2.157s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:32:59 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Created reservations ['7d6f3144-b182-4a31-87ed-a56836b10069', 'e62f9bfe-d6e9-4c89-af28-3d25884a0604', 'c1662977-a846-430d-b885-628baa62e78e', '6e86f132-47fd-42a3-bcc9-fd620a47f4e2'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:32:59 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Delete snapshot completed successfully. Aug 13 09:32:59 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6f30aad8-85b7-4735-a010-971f2f27858c tempest-CinderUnicodeTest-728735239 None] Lock "cinder-c241de52-6854-4e62-a6f1-cda129dbdada-delete_snapshot" released by "delete_snapshot" :: held 2.393s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Acquiring lock "cinder-889cee90-342f-41b3-9be8-8f9206bf1b20-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Lock "cinder-889cee90-342f-41b3-9be8-8f9206bf1b20-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Acquiring lock "cinder-quobyte-889cee90-342f-41b3-9be8-8f9206bf1b20" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Lock "cinder-quobyte-889cee90-342f-41b3-9be8-8f9206bf1b20" acquired by "delete_volume" :: waited 0.028s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:00 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9411e9f-2bc3-4883-9b6c-8e14b60c331a]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:33:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:01 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20 Aug 13 09:33:01 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:01 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20" returned: 0 in 0.826s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:01 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20 Aug 13 09:33:01 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:02 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-889cee90-342f-41b3-9be8-8f9206bf1b20" returned: 0 in 0.364s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Lock "cinder-quobyte-889cee90-342f-41b3-9be8-8f9206bf1b20" released by "delete_volume" :: held 1.321s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:02 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Created reservations ['5c485449-87e4-499d-8a36-ae22a6ecf01b', '2ddf458b-1512-4105-ac08-c246b870544f', '15029c03-7527-4eb3-b8ad-83c3d507088b', 'b1cdb5e3-bf65-4bf6-8bf2-f68782b5c12a'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:33:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:02 devstack sudo[109285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:33:02 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:02 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.447s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:02 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:33:02 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Deleted volume successfully. Aug 13 09:33:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8894fdaa-ba3a-445c-a54b-4c3e8fbd8d8c tempest-CinderUnicodeTest-728735239 None] Lock "cinder-889cee90-342f-41b3-9be8-8f9206bf1b20-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:03 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Acquiring lock "cinder-01d7c7fd-d835-4314-a376-9e3c70c846cd-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:03 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Lock "cinder-01d7c7fd-d835-4314-a376-9e3c70c846cd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:03 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Acquiring lock "cinder-quobyte-01d7c7fd-d835-4314-a376-9e3c70c846cd" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:03 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Lock "cinder-quobyte-01d7c7fd-d835-4314-a376-9e3c70c846cd" acquired by "delete_volume" :: waited 0.035s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:03 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d3f5a7-797d-47d5-82a0-1cfc77dd30d1]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:33:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-01d7c7fd-d835-4314-a376-9e3c70c846cd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:03 devstack sudo[109303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-01d7c7fd-d835-4314-a376-9e3c70c846cd Aug 13 09:33:03 devstack sudo[109303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:03 devstack sudo[109303]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-01d7c7fd-d835-4314-a376-9e3c70c846cd" returned: 0 in 0.675s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-01d7c7fd-d835-4314-a376-9e3c70c846cd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:04 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-01d7c7fd-d835-4314-a376-9e3c70c846cd Aug 13 09:33:04 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:04 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-01d7c7fd-d835-4314-a376-9e3c70c846cd" returned: 0 in 0.615s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-35fb43a9-4020-468f-b0ae-11c9a8fc729f tempest-BackendsCapabilitiesAdminTestsJSON-1074524785 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94670) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 13 09:33:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Lock "cinder-quobyte-01d7c7fd-d835-4314-a376-9e3c70c846cd" released by "delete_volume" :: held 1.381s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5d95d710-fd54-4e54-844a-e17ee6772e2a tempest-BackendsCapabilitiesAdminTestsJSON-1074524785 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94670) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 13 09:33:04 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Created reservations ['568d4505-c2af-469d-bb09-26f0eb7aa5c7', 'a2d3ef42-92ae-44a1-a727-906019c8f0c1', '964b31d1-9d08-4fbe-8bb7-c0744952711d', 'e73267b2-41ab-4558-86f8-5b8cb936d895'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:33:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:05 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:33:05 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:05 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.677s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:05 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:33:05 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Deleted volume successfully. Aug 13 09:33:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8b78ff62-79c8-425d-a195-028162cca0d1 tempest-CinderUnicodeTest-728735239 None] Lock "cinder-01d7c7fd-d835-4314-a376-9e3c70c846cd-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:14 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=95,cinder:UPDATE=105,cinder:INSERT=37,cinder:DELETE=7 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:33:15 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=98,cinder:UPDATE=101,cinder:DELETE=9,cinder:INSERT=27 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:33:16 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:33:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Flow 'volume_create_manager' (2075a75a-1a8b-4fec-a221-083a5fb43cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:33:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3455c8f-5c8c-4c57-853c-79c95974f0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3455c8f-5c8c-4c57-853c-79c95974f0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003731888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f499872-130f-4029-9028-889e2a0ce2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65b493da809426997c032549aa0f5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:33:17Z,use_quota=True,user_id='754f9b3168d4466a85ef665663274203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fc2782-e54e-49ca-b996-b79974281659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fc2782-e54e-49ca-b996-b79974281659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60df1cc0-468a-4519-a2bf-75877a0663bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60df1cc0-468a-4519-a2bf-75877a0663bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f499872-130f-4029-9028-889e2a0ce2bd', 'volume_name': 'volume-9f499872-130f-4029-9028-889e2a0ce2bd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745a32c3-2a95-43c4-b641-2bcd28249007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745a32c3-2a95-43c4-b641-2bcd28249007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed013ea0-361a-4eb0-9578-bc92283679a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:17 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Volume 9f499872-130f-4029-9028-889e2a0ce2bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f499872-130f-4029-9028-889e2a0ce2bd', 'volume_size': 1} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003731888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f499872-130f-4029-9028-889e2a0ce2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65b493da809426997c032549aa0f5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:33:17Z,use_quota=True,user_id='754f9b3168d4466a85ef665663274203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Creating volume 9f499872-130f-4029-9028-889e2a0ce2bd {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:33:17 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f499872-130f-4029-9028-889e2a0ce2bd 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:17 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f499872-130f-4029-9028-889e2a0ce2bd 1073741824 Aug 13 09:33:17 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:17 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f499872-130f-4029-9028-889e2a0ce2bd 1073741824" returned: 0 in 0.707s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f499872-130f-4029-9028-889e2a0ce2bd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:17 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f499872-130f-4029-9028-889e2a0ce2bd Aug 13 09:33:17 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:18 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f499872-130f-4029-9028-889e2a0ce2bd" returned: 0 in 0.379s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:33:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed013ea0-361a-4eb0-9578-bc92283679a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f499872-130f-4029-9028-889e2a0ce2bd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d7f4ef-546a-430a-b6ce-011a8d79c187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:18 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Volume volume-9f499872-130f-4029-9028-889e2a0ce2bd (9f499872-130f-4029-9028-889e2a0ce2bd): created successfully Aug 13 09:33:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d7f4ef-546a-430a-b6ce-011a8d79c187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Flow 'volume_create_manager' (2075a75a-1a8b-4fec-a221-083a5fb43cca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:33:18 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-0a2b00ed-0d57-432c-9e2d-0f53881ab2dd tempest-ProjectReaderTests-55911081 None] Created volume successfully. Aug 13 09:33:18 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3b41b6fe-351c-4f07-856d-51e9375e2602 tempest-GroupSnapshotsTest-964973595 None] Group tempest-GroupSnapshotsTest-Group-1102693840: creating Aug 13 09:33:18 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3b41b6fe-351c-4f07-856d-51e9375e2602 tempest-GroupSnapshotsTest-964973595 None] Group tempest-GroupSnapshotsTest-Group-1102693840: created successfully Aug 13 09:33:18 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3b41b6fe-351c-4f07-856d-51e9375e2602 tempest-GroupSnapshotsTest-964973595 None] Create group completed successfully. Aug 13 09:33:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Acquiring lock "cinder-9f499872-130f-4029-9028-889e2a0ce2bd-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Lock "cinder-9f499872-130f-4029-9028-889e2a0ce2bd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Acquiring lock "cinder-quobyte-9f499872-130f-4029-9028-889e2a0ce2bd" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Lock "cinder-quobyte-9f499872-130f-4029-9028-889e2a0ce2bd" acquired by "delete_volume" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:19 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbca6ad9-824f-4cd2-97f9-214c70672c3f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:33:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f499872-130f-4029-9028-889e2a0ce2bd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:19 devstack sudo[109329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f499872-130f-4029-9028-889e2a0ce2bd Aug 13 09:33:19 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:20 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f499872-130f-4029-9028-889e2a0ce2bd" returned: 0 in 0.648s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f499872-130f-4029-9028-889e2a0ce2bd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:20 devstack sudo[109359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f499872-130f-4029-9028-889e2a0ce2bd Aug 13 09:33:20 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:20 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9f499872-130f-4029-9028-889e2a0ce2bd" returned: 0 in 0.558s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Lock "cinder-quobyte-9f499872-130f-4029-9028-889e2a0ce2bd" released by "delete_volume" :: held 1.295s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:20 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Created reservations ['e1a7717b-46da-4c3d-833a-1c3167e749b4', 'dd928d54-d806-40f5-80e4-697880815c57', 'b2c8cc14-d606-4174-a9b5-6527f9629754', '4b577dde-5171-4f0f-b0ad-a5b43d2045c8'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:21 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:33:21 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Flow 'volume_create_manager' (37e09524-b779-4b6f-bf2e-1b2385b80e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c878ae78-f844-466e-bcd8-521960894843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:21 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c878ae78-f844-466e-bcd8-521960894843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1127691485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ad2aec10-2fcf-4934-8e4e-1a4d4a7e777f,host='devstack@QuobyteHD#QuobyteHD',id=bca7bad9-a78f-45f2-bd8d-831b6dbd76c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852f43863a9543e2a6cdaca06883a3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:33:21Z,use_quota=True,user_id='ea74ed8c6d774b0baa67aaacc7ae0c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1efb560a-9d4a-469d-ae3a-d58a14bb02f9),volume_type_id=1efb560a-9d4a-469d-ae3a-d58a14bb02f9)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451a7667-1e5a-46b6-a914-07e12d251efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451a7667-1e5a-46b6-a914-07e12d251efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d5c8e7-b8e5-4765-80c4-6be9f09aa4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d5c8e7-b8e5-4765-80c4-6be9f09aa4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca7bad9-a78f-45f2-bd8d-831b6dbd76c7', 'volume_name': 'volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130a4198-81f1-4d08-ba4a-8daa630abf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130a4198-81f1-4d08-ba4a-8daa630abf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a55d0fd-95c4-4dfe-9de9-bbe7aaae1b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:21 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Volume bca7bad9-a78f-45f2-bd8d-831b6dbd76c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7', 'volume_size': 1} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ad2aec10-2fcf-4934-8e4e-1a4d4a7e777f,created_at=2026-08-13T07:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1127691485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ad2aec10-2fcf-4934-8e4e-1a4d4a7e777f,host='devstack@QuobyteHD#QuobyteHD',id=bca7bad9-a78f-45f2-bd8d-831b6dbd76c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852f43863a9543e2a6cdaca06883a3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:33:21Z,use_quota=True,user_id='ea74ed8c6d774b0baa67aaacc7ae0c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1efb560a-9d4a-469d-ae3a-d58a14bb02f9),volume_type_id=1efb560a-9d4a-469d-ae3a-d58a14bb02f9)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Creating volume bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:33:21 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.553s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:33:21 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Deleted volume successfully. Aug 13 09:33:21 devstack sudo[109441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 1073741824 Aug 13 09:33:21 devstack sudo[109441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d6318753-8528-40c1-a454-62c96775dd29 tempest-ProjectReaderTests-55911081 None] Lock "cinder-9f499872-130f-4029-9028-889e2a0ce2bd-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:22 devstack sudo[109441]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 1073741824" returned: 0 in 0.717s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:22 devstack sudo[109447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 Aug 13 09:33:22 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Flow 'volume_create_manager' (6f015375-642b-4410-bc6a-c87f73c9ae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea57f500-7fe3-4e5a-84bf-5011333f999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea57f500-7fe3-4e5a-84bf-5011333f999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-505923675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b76f9ae-1791-41ad-9ca8-55c9566c3600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65b493da809426997c032549aa0f5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:33:22Z,use_quota=True,user_id='754f9b3168d4466a85ef665663274203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69580645-4703-443f-9687-c5377a2b208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69580645-4703-443f-9687-c5377a2b208e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec370f3-8f61-4ca2-b857-703d8089c17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec370f3-8f61-4ca2-b857-703d8089c17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b76f9ae-1791-41ad-9ca8-55c9566c3600', 'volume_name': 'volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eacc374d-c4db-4433-90f1-0eed398fde78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eacc374d-c4db-4433-90f1-0eed398fde78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7bca41-fc0f-4985-a6b0-000822447b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:22 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Volume 0b76f9ae-1791-41ad-9ca8-55c9566c3600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600', 'volume_size': 1} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:22 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7" returned: 0 in 0.490s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.121s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-505923675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b76f9ae-1791-41ad-9ca8-55c9566c3600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65b493da809426997c032549aa0f5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:33:22Z,use_quota=True,user_id='754f9b3168d4466a85ef665663274203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Creating volume 0b76f9ae-1791-41ad-9ca8-55c9566c3600 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:33:22 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a55d0fd-95c4-4dfe-9de9-bbe7aaae1b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510f199c-900e-457d-8019-106c4b508bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:22 devstack sudo[109452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600 1073741824 Aug 13 09:33:22 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:22 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Volume volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 (bca7bad9-a78f-45f2-bd8d-831b6dbd76c7): created successfully Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510f199c-900e-457d-8019-106c4b508bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Flow 'volume_create_manager' (37e09524-b779-4b6f-bf2e-1b2385b80e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:33:22 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-09ba293c-63a7-4171-9aa5-873a8a71dccd tempest-GroupSnapshotsTest-964973595 None] Created volume successfully. Aug 13 09:33:23 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600 1073741824" returned: 0 in 0.544s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:23 devstack sudo[109458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600 Aug 13 09:33:23 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:23 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600" returned: 0 in 0.290s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:33:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7bca41-fc0f-4985-a6b0-000822447b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0fe661-0242-42b3-aee4-c7ffc854c2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:23 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Volume volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600 (0b76f9ae-1791-41ad-9ca8-55c9566c3600): created successfully Aug 13 09:33:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0fe661-0242-42b3-aee4-c7ffc854c2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Flow 'volume_create_manager' (6f015375-642b-4410-bc6a-c87f73c9ae71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:33:23 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-05a5f5cf-6296-4490-8377-c83eaa9b7137 tempest-ProjectReaderTests-55911081 None] Created volume successfully. Aug 13 09:33:24 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] GroupSnapshot 009898e5-c109-489d-9983-a2df9eadeb34: creating. Aug 13 09:33:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] Group snapshot 009898e5-c109-489d-9983-a2df9eadeb34: creating. {{(pid=94670) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 13 09:33:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] Creating offline snapshot 7ff25f75-69ca-494f-9ad2-be32107c9f49 of volume bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:33:24 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fbcfe7-c438-4d21-a7e5-d5192b5baf2a]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:33:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:24 devstack sudo[109461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 Aug 13 09:33:24 devstack sudo[109461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Acquiring lock "cinder-0b76f9ae-1791-41ad-9ca8-55c9566c3600-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Lock "cinder-0b76f9ae-1791-41ad-9ca8-55c9566c3600-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Acquiring lock "cinder-quobyte-0b76f9ae-1791-41ad-9ca8-55c9566c3600" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:24 devstack sudo[109461]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7" returned: 0 in 0.509s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:24 devstack sudo[109466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 1G Aug 13 09:33:24 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Lock "cinder-quobyte-0b76f9ae-1791-41ad-9ca8-55c9566c3600" acquired by "delete_volume" :: waited 0.046s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:24 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1eea44d-3d1b-41d3-9c72-0ce4ecc4abc1]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:33:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:24 devstack sudo[109468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600 Aug 13 09:33:24 devstack sudo[109468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:25 devstack sudo[109468]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600" returned: 0 in 0.488s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:25 devstack sudo[109477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600 Aug 13 09:33:25 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:25 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 1G" returned: 0 in 0.734s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:25 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 Aug 13 09:33:25 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:25 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0b76f9ae-1791-41ad-9ca8-55c9566c3600" returned: 0 in 0.329s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Lock "cinder-quobyte-0b76f9ae-1791-41ad-9ca8-55c9566c3600" released by "delete_volume" :: held 0.897s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:25 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Created reservations ['1e1d24c2-7382-4195-b8cd-09887a8afbee', 'c7a21ba2-f6fb-417e-8cce-5cb5d7b98856', 'b8adf281-f5c8-452e-af24-06eba4537b93', '98b04118-7180-44a4-aa4b-0c4fde3609a1'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:33:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:25 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49" returned: 0 in 0.415s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:25 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 is being set with open permissions: ugo+rw: NotImplementedError Aug 13 09:33:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:25 devstack sudo[109485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:33:25 devstack sudo[109485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:25 devstack sudo[109486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 Aug 13 09:33:25 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:26 devstack sudo[109485]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.273s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:26 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:33:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Deleted volume successfully. Aug 13 09:33:26 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49" returned: 0 in 0.282s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-065d8e46-0288-4d05-ad0f-2d06440b0bf5 tempest-ProjectReaderTests-55911081 None] Lock "cinder-0b76f9ae-1791-41ad-9ca8-55c9566c3600-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:26 devstack sudo[109491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.info Aug 13 09:33:26 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:26 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.info" returned: 0 in 0.291s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:26 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.info is being set with open permissions: ugo+rw: NotImplementedError Aug 13 09:33:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:26 devstack sudo[109494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.info Aug 13 09:33:26 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:26 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.info" returned: 0 in 0.300s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-be0321ca-9312-4b1a-a4d9-c9b3dcc6f88f tempest-GroupSnapshotsTest-964973595 None] group_snapshot 009898e5-c109-489d-9983-a2df9eadeb34: created successfully Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Flow 'volume_create_manager' (3d25e624-144b-4d52-b61a-9c553be20a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07131b02-ce24-48a3-a3db-fe91bb58d120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07131b02-ce24-48a3-a3db-fe91bb58d120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160133882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f00f01-fb3e-461a-800c-717873355709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65b493da809426997c032549aa0f5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:33:27Z,use_quota=True,user_id='754f9b3168d4466a85ef665663274203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27345a50-133f-41b5-b549-80ad3e6f559d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27345a50-133f-41b5-b549-80ad3e6f559d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c226691-4fb1-4c05-a08c-15ac49f54866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c226691-4fb1-4c05-a08c-15ac49f54866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f00f01-fb3e-461a-800c-717873355709', 'volume_name': 'volume-78f00f01-fb3e-461a-800c-717873355709', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836e5b73-4882-41d0-a5ae-9bea437c3b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836e5b73-4882-41d0-a5ae-9bea437c3b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89727f0-8b99-469e-aba0-b02e7cd5d067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:27 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Volume 78f00f01-fb3e-461a-800c-717873355709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f00f01-fb3e-461a-800c-717873355709', 'volume_size': 1} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160133882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f00f01-fb3e-461a-800c-717873355709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65b493da809426997c032549aa0f5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:33:27Z,use_quota=True,user_id='754f9b3168d4466a85ef665663274203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Creating volume 78f00f01-fb3e-461a-800c-717873355709 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:33:27 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:33:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-78f00f01-fb3e-461a-800c-717873355709 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:27 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-78f00f01-fb3e-461a-800c-717873355709 1073741824 Aug 13 09:33:27 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:28 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-78f00f01-fb3e-461a-800c-717873355709 1073741824" returned: 0 in 0.565s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-78f00f01-fb3e-461a-800c-717873355709 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:28 devstack sudo[109503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-78f00f01-fb3e-461a-800c-717873355709 Aug 13 09:33:28 devstack sudo[109503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:28 devstack sudo[109503]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-78f00f01-fb3e-461a-800c-717873355709" returned: 0 in 0.357s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.495s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "cinder-quobyte-7ff25f75-69ca-494f-9ad2-be32107c9f49-69d28f8a-4493-4441-8f0f-2d2253898068" by "_create_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89727f0-8b99-469e-aba0-b02e7cd5d067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f00f01-fb3e-461a-800c-717873355709', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d748d2-5fbd-4ecc-a23a-362a7515f661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-7ff25f75-69ca-494f-9ad2-be32107c9f49-69d28f8a-4493-4441-8f0f-2d2253898068" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Creating volume 69d28f8a-4493-4441-8f0f-2d2253898068 from snapshot 7ff25f75-69ca-494f-9ad2-be32107c9f49 {{(pid=94670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "cinder-quobyte-69d28f8a-4493-4441-8f0f-2d2253898068" by "_copy_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:28 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Volume volume-78f00f01-fb3e-461a-800c-717873355709 (78f00f01-fb3e-461a-800c-717873355709): created successfully Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d748d2-5fbd-4ecc-a23a-362a7515f661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Flow 'volume_create_manager' (3d25e624-144b-4d52-b61a-9c553be20a0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-69d28f8a-4493-4441-8f0f-2d2253898068" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] snapshot: 7ff25f75-69ca-494f-9ad2-be32107c9f49, volume: 69d28f8a-4493-4441-8f0f-2d2253898068, {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 13 09:33:28 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-20028668-cd4e-40b7-8578-de771401eb85 tempest-ProjectReaderTests-55911081 None] Created volume successfully. Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6491eb-1fc5-41c4-8e9a-0dbfa295afbd]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:33:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:28 devstack sudo[109506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 Aug 13 09:33:28 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:29 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49" returned: 0 in 0.568s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:33:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 13 09:33:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Creating direct copy from snapshot {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 13 09:33:29 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeb93af-ac1e-48c9-94de-17e4e9ca8640]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:33:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:29 devstack sudo[109548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 Aug 13 09:33:29 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Acquiring lock "cinder-78f00f01-fb3e-461a-800c-717873355709-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Lock "cinder-78f00f01-fb3e-461a-800c-717873355709-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Acquiring lock "cinder-quobyte-78f00f01-fb3e-461a-800c-717873355709" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Lock "cinder-quobyte-78f00f01-fb3e-461a-800c-717873355709" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:30 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[62175f85-2ab4-4530-871b-107252fc8ae9]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:33:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-78f00f01-fb3e-461a-800c-717873355709 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:30 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7" returned: 0 in 0.775s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:30 devstack cinder-volume[94670]: DEBUG cinder.utils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Path /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69d28f8a-4493-4441-8f0f-2d2253898068 not found in is_blk_device check {{(pid=94670) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 13 09:33:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69d28f8a-4493-4441-8f0f-2d2253898068 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:30 devstack sudo[109557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69d28f8a-4493-4441-8f0f-2d2253898068 Aug 13 09:33:30 devstack sudo[109554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-78f00f01-fb3e-461a-800c-717873355709 Aug 13 09:33:30 devstack sudo[109557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:30 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:30 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-78f00f01-fb3e-461a-800c-717873355709" returned: 0 in 0.537s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-78f00f01-fb3e-461a-800c-717873355709 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:30 devstack sudo[109566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-78f00f01-fb3e-461a-800c-717873355709 Aug 13 09:33:30 devstack sudo[109566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:31 devstack sudo[109566]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-78f00f01-fb3e-461a-800c-717873355709" returned: 0 in 0.468s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Lock "cinder-quobyte-78f00f01-fb3e-461a-800c-717873355709" released by "delete_volume" :: held 1.103s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:31 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Created reservations ['f37ec8ba-aa5e-4346-a1d0-ed13fe8066c9', '70f3497c-f739-4cda-aff1-6da0863bba1b', '6c6d98f2-cab9-4416-b73d-19efaf9b3293', '00c0dc3d-b83b-4c1b-945d-5932a37d4c6c'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:33:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:31 devstack sudo[109577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:33:31 devstack sudo[109577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:32 devstack sudo[109577]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.696s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:32 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:33:32 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Deleted volume successfully. Aug 13 09:33:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1884b926-bba6-4711-a5fe-8ed74518fabf tempest-ProjectReaderTests-55911081 None] Lock "cinder-78f00f01-fb3e-461a-800c-717873355709-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:34 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:33:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Flow 'volume_create_manager' (36d96161-3633-419a-be3b-4f4ac98ea167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:33:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bafefe2-54f7-4b07-9428-3be24d748f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bafefe2-54f7-4b07-9428-3be24d748f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-362211134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab093bc-aef9-40d4-96b7-aadd01785bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65b493da809426997c032549aa0f5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:33:34Z,use_quota=True,user_id='754f9b3168d4466a85ef665663274203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822076c5-ce6a-470e-9674-c08c9b690125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822076c5-ce6a-470e-9674-c08c9b690125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0c2935-848c-428e-babf-98cd458dda29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0c2935-848c-428e-babf-98cd458dda29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab093bc-aef9-40d4-96b7-aadd01785bea', 'volume_name': 'volume-4ab093bc-aef9-40d4-96b7-aadd01785bea', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2443553-21df-41d5-ab8c-f0758fc38fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2443553-21df-41d5-ab8c-f0758fc38fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8968b5e9-ebcc-43b5-a889-0e5f072982b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:34 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Volume 4ab093bc-aef9-40d4-96b7-aadd01785bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab093bc-aef9-40d4-96b7-aadd01785bea', 'volume_size': 1} Aug 13 09:33:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:37 devstack sudo[109557]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69d28f8a-4493-4441-8f0f-2d2253898068" returned: 0 in 7.063s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:37 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b768796-321d-46d1-8c53-577e94ecf1d3]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:33:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:37 devstack sudo[109609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 Aug 13 09:33:37 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:37 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7" returned: 0 in 0.729s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:37 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Image conversion details: src /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7, size 1024.00 MB, duration 7.06 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69d28f8a-4493-4441-8f0f-2d2253898068 {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:33:37 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Converted 1024.00 MB image at 144.95 MB/s Aug 13 09:33:37 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69d28f8a-4493-4441-8f0f-2d2253898068 is being set with open permissions: ugo+rw: NotImplementedError Aug 13 09:33:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69d28f8a-4493-4441-8f0f-2d2253898068 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:37 devstack sudo[109621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69d28f8a-4493-4441-8f0f-2d2253898068 Aug 13 09:33:37 devstack sudo[109621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:38 devstack sudo[109621]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69d28f8a-4493-4441-8f0f-2d2253898068" returned: 0 in 0.279s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-69d28f8a-4493-4441-8f0f-2d2253898068" released by "_copy_volume_from_snapshot" :: held 9.548s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-7ff25f75-69ca-494f-9ad2-be32107c9f49-69d28f8a-4493-4441-8f0f-2d2253898068" released by "_create_volume_from_snapshot" :: held 9.603s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.639s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.336s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-362211134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab093bc-aef9-40d4-96b7-aadd01785bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65b493da809426997c032549aa0f5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:33:34Z,use_quota=True,user_id='754f9b3168d4466a85ef665663274203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:33:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Creating volume 4ab093bc-aef9-40d4-96b7-aadd01785bea {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:33:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:33:38 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:33:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4ab093bc-aef9-40d4-96b7-aadd01785bea 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:38 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4ab093bc-aef9-40d4-96b7-aadd01785bea 1073741824 Aug 13 09:33:38 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:38 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-890555cb-6e2a-4754-8d81-eb1d82e17afd tempest-GroupSnapshotsTest-964973595 None] Create group from source-snapshot-009898e5-c109-489d-9983-a2df9eadeb34 completed successfully. Aug 13 09:33:39 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4ab093bc-aef9-40d4-96b7-aadd01785bea 1073741824" returned: 0 in 1.115s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4ab093bc-aef9-40d4-96b7-aadd01785bea {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:39 devstack sudo[109695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4ab093bc-aef9-40d4-96b7-aadd01785bea Aug 13 09:33:39 devstack sudo[109695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "cinder-quobyte-69d28f8a-4493-4441-8f0f-2d2253898068" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-69d28f8a-4493-4441-8f0f-2d2253898068" acquired by "delete_volume" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:40 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3621d8ee-d62b-477d-bcf2-c4cc9027c9a8]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:33:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69d28f8a-4493-4441-8f0f-2d2253898068 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:40 devstack sudo[109695]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4ab093bc-aef9-40d4-96b7-aadd01785bea" returned: 0 in 0.702s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:33:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8968b5e9-ebcc-43b5-a889-0e5f072982b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab093bc-aef9-40d4-96b7-aadd01785bea', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd59b7c-90ea-4d67-92e8-4bf61d0eb1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:40 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Volume volume-4ab093bc-aef9-40d4-96b7-aadd01785bea (4ab093bc-aef9-40d4-96b7-aadd01785bea): created successfully Aug 13 09:33:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd59b7c-90ea-4d67-92e8-4bf61d0eb1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Flow 'volume_create_manager' (36d96161-3633-419a-be3b-4f4ac98ea167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:33:40 devstack sudo[109716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69d28f8a-4493-4441-8f0f-2d2253898068 Aug 13 09:33:40 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:40 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e05a8c1f-1afa-457b-8f1c-964593ae134e tempest-ProjectReaderTests-55911081 None] Created volume successfully. Aug 13 09:33:40 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-698ceb4e-1ea0-477a-9256-507d52415d9b req-9ddf7740-8e2a-465a-b352-750684d98e54 tempest-TestShelveInstance-59204464 None] Terminate volume connection completed successfully. Aug 13 09:33:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-698ceb4e-1ea0-477a-9256-507d52415d9b req-9ddf7740-8e2a-465a-b352-750684d98e54 tempest-TestShelveInstance-59204464 None] Deleting attachment 2cf22b29-5db8-4ea4-a430-f18d4929f863. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:33:40 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69d28f8a-4493-4441-8f0f-2d2253898068" returned: 0 in 0.695s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69d28f8a-4493-4441-8f0f-2d2253898068 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:40 devstack sudo[109739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69d28f8a-4493-4441-8f0f-2d2253898068 Aug 13 09:33:40 devstack sudo[109739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Acquiring lock "cinder-4ab093bc-aef9-40d4-96b7-aadd01785bea-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Lock "cinder-4ab093bc-aef9-40d4-96b7-aadd01785bea-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Acquiring lock "cinder-quobyte-4ab093bc-aef9-40d4-96b7-aadd01785bea" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:41 devstack sudo[109739]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69d28f8a-4493-4441-8f0f-2d2253898068" returned: 0 in 0.427s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Lock "cinder-quobyte-4ab093bc-aef9-40d4-96b7-aadd01785bea" acquired by "delete_volume" :: waited 0.036s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-69d28f8a-4493-4441-8f0f-2d2253898068" released by "delete_volume" :: held 1.245s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d96f86-8894-4957-9b66-2eb3ac48374e]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4ab093bc-aef9-40d4-96b7-aadd01785bea {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Created reservations ['6c9b1955-33ff-4a59-94e9-9827938fa7c0'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:33:41 devstack sudo[109742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4ab093bc-aef9-40d4-96b7-aadd01785bea Aug 13 09:33:41 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:41 devstack cinder-volume[94670]: WARNING cinder.quota [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-716783394 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-716783394, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:33:41 devstack cinder-volume[94670]: WARNING cinder.quota [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-716783394 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-716783394, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Created reservations ['000f283c-6333-4d12-9cb2-9aa3a628e331', '9b7a220f-cc69-4077-87cd-db908ea14592', '54281f48-ae29-423b-8f7a-9ccf0df81b2c', '275d361f-dcbc-4e54-b82a-abbbe8300ee6'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:41 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4ab093bc-aef9-40d4-96b7-aadd01785bea" returned: 0 in 0.522s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4ab093bc-aef9-40d4-96b7-aadd01785bea {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:41 devstack sudo[109749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:33:41 devstack sudo[109749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:41 devstack sudo[109750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4ab093bc-aef9-40d4-96b7-aadd01785bea Aug 13 09:33:41 devstack sudo[109750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:42 devstack sudo[109750]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4ab093bc-aef9-40d4-96b7-aadd01785bea" returned: 0 in 0.379s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Lock "cinder-quobyte-4ab093bc-aef9-40d4-96b7-aadd01785bea" released by "delete_volume" :: held 0.995s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.549s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:33:42 devstack sudo[109749]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:42 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b7c8d36d-758a-4afa-8a6d-b92c538a8ac6 tempest-GroupSnapshotsTest-964973595 None] Delete group completed successfully. Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Created reservations ['bd4e7895-70ac-4436-b573-27d72547f218', '6b1c862b-d013-42a4-a3ea-41bf7bf22cbd', '799e493c-9b17-42de-b8b6-2148e28fe7b8', '72becceb-7184-44b5-a345-7d13a7c22fea'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:42 devstack sudo[109756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:33:42 devstack sudo[109756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:42 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] group_snapshot 009898e5-c109-489d-9983-a2df9eadeb34: deleting Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] group_snapshot 009898e5-c109-489d-9983-a2df9eadeb34: deleting {{(pid=94670) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 13 09:33:42 devstack sudo[109756]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.370s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:33:42 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Deleted volume successfully. Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "cinder-quobyte-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-93999286-6e75-4bb6-bfff-5eb0f32328e9 tempest-ProjectReaderTests-55911081 None] Lock "cinder-4ab093bc-aef9-40d4-96b7-aadd01785bea-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7" acquired by "delete_snapshot" :: waited 0.047s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "cinder-quobyte-7ff25f75-69ca-494f-9ad2-be32107c9f49" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-7ff25f75-69ca-494f-9ad2-be32107c9f49" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] Deleting offline snapshot 7ff25f75-69ca-494f-9ad2-be32107c9f49 of volume bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] snapshot_file for this snap is: volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6269dc-5649-4471-b4aa-1178e8524bab]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:43 devstack sudo[109761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 Aug 13 09:33:43 devstack sudo[109761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:43 devstack sudo[109762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:33:43 devstack sudo[109762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:43 devstack sudo[109762]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:43 devstack sudo[109761]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.415s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49" returned: 0 in 0.575s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4916c14c-9eb2-4218-8a81-2284a2a601b2]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:33:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:43 devstack sudo[109769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 Aug 13 09:33:43 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:44 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7" returned: 0 in 0.633s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:44 devstack sudo[109783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 Aug 13 09:33:44 devstack sudo[109783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-6e634609-f525-4098-9821-f75088cf0b24 req-e776a3b8-5280-43df-af2b-a782a4b90402 tempest-TestShelveInstance-59204464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-6e634609-f525-4098-9821-f75088cf0b24 req-e776a3b8-5280-43df-af2b-a782a4b90402 tempest-TestShelveInstance-59204464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:44 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db85642-4abd-4c04-b664-c05af62b6552]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:33:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-6e634609-f525-4098-9821-f75088cf0b24 req-e776a3b8-5280-43df-af2b-a782a4b90402 tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:44 devstack sudo[109785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 Aug 13 09:33:44 devstack sudo[109785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:45 devstack sudo[109783]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49" returned: 0 in 0.747s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:45 devstack sudo[109792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49 Aug 13 09:33:45 devstack sudo[109792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:45 devstack sudo[109785]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-6e634609-f525-4098-9821-f75088cf0b24 req-e776a3b8-5280-43df-af2b-a782a4b90402 tempest-TestShelveInstance-59204464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0" returned: 0 in 0.560s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-6e634609-f525-4098-9821-f75088cf0b24 req-e776a3b8-5280-43df-af2b-a782a4b90402 tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:45 devstack sudo[109794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 Aug 13 09:33:45 devstack sudo[109794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:45 devstack sudo[109792]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7.7ff25f75-69ca-494f-9ad2-be32107c9f49" returned: 0 in 0.400s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-7ff25f75-69ca-494f-9ad2-be32107c9f49" released by "_delete_snapshot" :: held 2.524s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7" released by "delete_snapshot" :: held 2.568s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:45 devstack cinder-volume[94670]: WARNING cinder.quota [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-716783394 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-716783394, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:33:45 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] Created reservations ['82f0566a-4ff2-492f-9fa7-ffa7c8ecdca5', '1664c3ac-2f41-4b32-adf5-4821a234fdc9', 'e7ef9c43-e74a-4213-9a13-6b3b04d77df3', '4b4479bc-fe48-44b8-a07c-989e3046a66e'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:33:45 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b9e606d3-4dc9-4b2c-a091-8bd042d24ac1 tempest-GroupSnapshotsTest-964973595 None] group_snapshot 009898e5-c109-489d-9983-a2df9eadeb34: deleted successfully Aug 13 09:33:45 devstack sudo[109794]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-6e634609-f525-4098-9821-f75088cf0b24 req-e776a3b8-5280-43df-af2b-a782a4b90402 tempest-TestShelveInstance-59204464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0" returned: 1 in 0.786s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-6e634609-f525-4098-9821-f75088cf0b24 req-e776a3b8-5280-43df-af2b-a782a4b90402 tempest-TestShelveInstance-59204464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:33:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-6e634609-f525-4098-9821-f75088cf0b24 req-e776a3b8-5280-43df-af2b-a782a4b90402 tempest-TestShelveInstance-59204464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.448s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:46 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-6e634609-f525-4098-9821-f75088cf0b24 req-e776a3b8-5280-43df-af2b-a782a4b90402 tempest-TestShelveInstance-59204464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f006e77a-10b1-4b58-8713-41d9516a3b2c', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:33:46 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-6e634609-f525-4098-9821-f75088cf0b24 req-e776a3b8-5280-43df-af2b-a782a4b90402 tempest-TestShelveInstance-59204464 None] attachment_update completed successfully. Aug 13 09:33:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "cinder-quobyte-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:33:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7" acquired by "delete_volume" :: waited 0.033s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:33:47 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a63b4c3-6882-4978-a755-0d3546db3060]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:33:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:47 devstack sudo[109802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 Aug 13 09:33:47 devstack sudo[109802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:47 devstack sudo[109802]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7" returned: 0 in 0.461s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:47 devstack sudo[109808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7 Aug 13 09:33:47 devstack sudo[109808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:48 devstack sudo[109808]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7" returned: 0 in 0.340s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-bca7bad9-a78f-45f2-bd8d-831b6dbd76c7" released by "delete_volume" :: held 0.895s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:33:48 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Created reservations ['b7830646-8e59-4aa8-af5c-2a50c35be54e'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:33:48 devstack cinder-volume[94670]: WARNING cinder.db.api [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-716783394'] Aug 13 09:33:48 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Created reservations ['5dc734de-907e-4949-b7cd-dbff4ae0b8ae', 'dc3c91bc-7dd8-4926-95d5-b0f945ca1bfb', '57a75702-ccbc-443e-8847-a07bac668027', 'afbc6a7d-663d-4722-afb5-5163e598ca8f'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:33:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:48 devstack sudo[109811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:33:48 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:48 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.376s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:48 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:33:48 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-795684d5-66d3-418e-a305-bc3b72d87cbc tempest-GroupSnapshotsTest-964973595 None] Delete group completed successfully. Aug 13 09:33:49 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-87fc024a-f25d-4cb9-83a6-75cbcda251ed tempest-GroupSnapshotsTest-964973595 None] Group tempest-GroupSnapshotsTest-Group-1918156113: creating Aug 13 09:33:49 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-87fc024a-f25d-4cb9-83a6-75cbcda251ed tempest-GroupSnapshotsTest-964973595 None] Group tempest-GroupSnapshotsTest-Group-1918156113: created successfully Aug 13 09:33:49 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-87fc024a-f25d-4cb9-83a6-75cbcda251ed tempest-GroupSnapshotsTest-964973595 None] Create group completed successfully. Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Flow 'volume_create_manager' (e5afe49d-528a-481b-a328-1135781c2a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d81e78-c3c4-4694-8642-e7429626e85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d81e78-c3c4-4694-8642-e7429626e85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1974301660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5d4d889-a163-451c-8442-6c6bafc62994,host='devstack@QuobyteHD#QuobyteHD',id=8d6a7631-ec02-4d1e-abcb-837e08541f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852f43863a9543e2a6cdaca06883a3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:33:51Z,use_quota=True,user_id='ea74ed8c6d774b0baa67aaacc7ae0c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ceefa2f-3681-40f7-9b73-8a5cc7fd0fa6),volume_type_id=1ceefa2f-3681-40f7-9b73-8a5cc7fd0fa6)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09c29dd-856a-4d4f-9c60-257cdc372007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09c29dd-856a-4d4f-9c60-257cdc372007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600f20a9-37a7-4061-a9ea-5467b3b814e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600f20a9-37a7-4061-a9ea-5467b3b814e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d6a7631-ec02-4d1e-abcb-837e08541f10', 'volume_name': 'volume-8d6a7631-ec02-4d1e-abcb-837e08541f10', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec78159-dacb-4dd1-8d7d-4c43289c06aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec78159-dacb-4dd1-8d7d-4c43289c06aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a92702f-a2ab-4a8d-95ed-9959b79edf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:51 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Volume 8d6a7631-ec02-4d1e-abcb-837e08541f10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d6a7631-ec02-4d1e-abcb-837e08541f10', 'volume_size': 1} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e5d4d889-a163-451c-8442-6c6bafc62994,created_at=2026-08-13T07:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1974301660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5d4d889-a163-451c-8442-6c6bafc62994,host='devstack@QuobyteHD#QuobyteHD',id=8d6a7631-ec02-4d1e-abcb-837e08541f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852f43863a9543e2a6cdaca06883a3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:33:51Z,use_quota=True,user_id='ea74ed8c6d774b0baa67aaacc7ae0c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ceefa2f-3681-40f7-9b73-8a5cc7fd0fa6),volume_type_id=1ceefa2f-3681-40f7-9b73-8a5cc7fd0fa6)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Creating volume 8d6a7631-ec02-4d1e-abcb-837e08541f10 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:33:51 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:33:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:51 devstack sudo[110258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 1073741824 Aug 13 09:33:51 devstack sudo[110258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:52 devstack sudo[110258]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 1073741824" returned: 0 in 0.559s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:52 devstack sudo[110280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 Aug 13 09:33:52 devstack sudo[110280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:52 devstack sudo[110280]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10" returned: 0 in 0.275s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:33:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a92702f-a2ab-4a8d-95ed-9959b79edf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d6a7631-ec02-4d1e-abcb-837e08541f10', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42a6b33-e197-41db-a00e-ff3811eabb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:52 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Volume volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 (8d6a7631-ec02-4d1e-abcb-837e08541f10): created successfully Aug 13 09:33:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42a6b33-e197-41db-a00e-ff3811eabb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Flow 'volume_create_manager' (e5afe49d-528a-481b-a328-1135781c2a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:33:52 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-f6dfb0d3-c97e-4198-90e7-2f7bc605125b tempest-GroupSnapshotsTest-964973595 None] Created volume successfully. Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Flow 'volume_create_manager' (c038158c-8dda-4315-a5d7-ecc8423effde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2431e7e-051d-4cf9-abac-34fd18ed4202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2431e7e-051d-4cf9-abac-34fd18ed4202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-515933966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5d4d889-a163-451c-8442-6c6bafc62994,host='devstack@QuobyteHD#QuobyteHD',id=84cbb05a-c8de-4869-8d52-ffef3593a38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852f43863a9543e2a6cdaca06883a3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:33:54Z,use_quota=True,user_id='ea74ed8c6d774b0baa67aaacc7ae0c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ceefa2f-3681-40f7-9b73-8a5cc7fd0fa6),volume_type_id=1ceefa2f-3681-40f7-9b73-8a5cc7fd0fa6)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e006447f-442a-47e6-b069-c301816f6121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e006447f-442a-47e6-b069-c301816f6121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6855033a-8224-41ed-8c49-d59e07f20f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6855033a-8224-41ed-8c49-d59e07f20f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84cbb05a-c8de-4869-8d52-ffef3593a38f', 'volume_name': 'volume-84cbb05a-c8de-4869-8d52-ffef3593a38f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb084fc-b3b7-4b49-b714-2f01e2f30540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb084fc-b3b7-4b49-b714-2f01e2f30540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2886051-0b61-4973-a1d4-eb41028e9f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:53 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Volume 84cbb05a-c8de-4869-8d52-ffef3593a38f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84cbb05a-c8de-4869-8d52-ffef3593a38f', 'volume_size': 1} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e5d4d889-a163-451c-8442-6c6bafc62994,created_at=2026-08-13T07:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-515933966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5d4d889-a163-451c-8442-6c6bafc62994,host='devstack@QuobyteHD#QuobyteHD',id=84cbb05a-c8de-4869-8d52-ffef3593a38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852f43863a9543e2a6cdaca06883a3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:33:54Z,use_quota=True,user_id='ea74ed8c6d774b0baa67aaacc7ae0c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ceefa2f-3681-40f7-9b73-8a5cc7fd0fa6),volume_type_id=1ceefa2f-3681-40f7-9b73-8a5cc7fd0fa6)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Creating volume 84cbb05a-c8de-4869-8d52-ffef3593a38f {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:33:53 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:33:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:53 devstack sudo[110294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f 1073741824 Aug 13 09:33:53 devstack sudo[110294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:54 devstack sudo[110294]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f 1073741824" returned: 0 in 0.539s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:33:54 devstack sudo[110306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f Aug 13 09:33:54 devstack sudo[110306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:33:54 devstack sudo[110306]: pam_unix(sudo:session): session closed for user root Aug 13 09:33:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f" returned: 0 in 0.294s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:33:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:33:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:33:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2886051-0b61-4973-a1d4-eb41028e9f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84cbb05a-c8de-4869-8d52-ffef3593a38f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1a22ab-c704-473c-bc36-e9ba1ae68366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:33:54 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Volume volume-84cbb05a-c8de-4869-8d52-ffef3593a38f (84cbb05a-c8de-4869-8d52-ffef3593a38f): created successfully Aug 13 09:33:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1a22ab-c704-473c-bc36-e9ba1ae68366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:33:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Flow 'volume_create_manager' (c038158c-8dda-4315-a5d7-ecc8423effde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:33:54 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-17fc168a-be62-46b2-a82e-fed78b90e301 tempest-GroupSnapshotsTest-964973595 None] Created volume successfully. Aug 13 09:33:56 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-efb42524-21aa-478b-a9d5-912ed6af38ea tempest-GroupSnapshotsTest-964973595 None] Update group completed successfully. Aug 13 09:33:57 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-ecbb1423-6b0e-4297-8571-108058c6da6b tempest-GroupSnapshotsTest-964973595 None] Update group completed successfully. Aug 13 09:33:58 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-945ce221-da3b-449f-8e96-e15f6fa8545f tempest-GroupSnapshotsTest-964973595 None] Update group completed successfully. Aug 13 09:34:00 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-45b58d76-d8e6-4e88-8b71-b74ad74f934e tempest-GroupSnapshotsTest-964973595 None] Update group completed successfully. Aug 13 09:34:01 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] GroupSnapshot 8066f648-2afb-4df8-8643-4ac56e24891e: creating. Aug 13 09:34:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Group snapshot 8066f648-2afb-4df8-8643-4ac56e24891e: creating. {{(pid=94670) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 13 09:34:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Creating offline snapshot 92f6f33c-cb7b-417c-824b-8e83b8cc6421 of volume 84cbb05a-c8de-4869-8d52-ffef3593a38f {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:34:01 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2785c120-18cd-421d-b3d8-20473d202886]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:01 devstack sudo[110326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f Aug 13 09:34:01 devstack sudo[110326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:02 devstack sudo[110326]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f" returned: 0 in 0.401s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:02 devstack sudo[110331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421 1G Aug 13 09:34:02 devstack sudo[110331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:02 devstack sudo[110331]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421 1G" returned: 0 in 0.437s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84cbb05a-c8de-4869-8d52-ffef3593a38f -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:02 devstack sudo[110336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84cbb05a-c8de-4869-8d52-ffef3593a38f -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421 Aug 13 09:34:02 devstack sudo[110336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:02 devstack sudo[110336]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84cbb05a-c8de-4869-8d52-ffef3593a38f -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421" returned: 0 in 0.316s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:02 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421 is being set with open permissions: ugo+rw: NotImplementedError Aug 13 09:34:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:02 devstack sudo[110341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421 Aug 13 09:34:02 devstack sudo[110341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:03 devstack sudo[110341]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421" returned: 0 in 0.296s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:03 devstack sudo[110344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.info Aug 13 09:34:03 devstack sudo[110344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:03 devstack sudo[110344]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.info" returned: 0 in 0.263s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:03 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.info is being set with open permissions: ugo+rw: NotImplementedError Aug 13 09:34:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:03 devstack sudo[110347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.info Aug 13 09:34:03 devstack sudo[110347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:03 devstack sudo[110347]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.info" returned: 0 in 0.317s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.133s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Creating offline snapshot cf2c3941-bcd8-44dd-b2ba-c86882441869 of volume 8d6a7631-ec02-4d1e-abcb-837e08541f10 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:34:03 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3eb79d8-643b-44d4-996b-71ce37e3d7f2]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:03 devstack sudo[110350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 Aug 13 09:34:03 devstack sudo[110350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:04 devstack sudo[110350]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10" returned: 0 in 0.386s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:04 devstack sudo[110356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869 1G Aug 13 09:34:04 devstack sudo[110356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:04 devstack sudo[110356]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869 1G" returned: 0 in 0.426s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:04 devstack sudo[110363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869 Aug 13 09:34:04 devstack sudo[110363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:04 devstack sudo[110363]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869" returned: 0 in 0.313s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:04 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869 is being set with open permissions: ugo+rw: NotImplementedError Aug 13 09:34:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:04 devstack sudo[110368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869 Aug 13 09:34:04 devstack sudo[110368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:05 devstack sudo[110368]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869" returned: 0 in 0.251s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:05 devstack sudo[110371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.info Aug 13 09:34:05 devstack sudo[110371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:05 devstack sudo[110371]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.info" returned: 0 in 0.261s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:05 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.info is being set with open permissions: ugo+rw: NotImplementedError Aug 13 09:34:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:05 devstack sudo[110374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.info Aug 13 09:34:05 devstack sudo[110374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:05 devstack sudo[110374]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.info" returned: 0 in 0.252s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:05 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-210c74d1-20ff-4beb-b00f-456e5654b769 tempest-GroupSnapshotsTest-964973595 None] group_snapshot 8066f648-2afb-4df8-8643-4ac56e24891e: created successfully Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Flow 'volume_create_manager' (0db05bfa-5d08-4830-87a2-fa198c60a324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d79e29-790e-47ff-9ba2-65406c636ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:07 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] group_snapshot 8066f648-2afb-4df8-8643-4ac56e24891e: deleting Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d79e29-790e-47ff-9ba2-65406c636ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1589571718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2708f5ff-0443-4df7-bd3e-2caee09bd2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12a2457bc4134f27babd977520fa7ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:34:07Z,use_quota=True,user_id='df1c7f632ad74e228af4584cae0d2e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edb055d-3e46-4cb0-8f2d-38f335fbae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edb055d-3e46-4cb0-8f2d-38f335fbae71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90bf7793-fae7-4ef3-9365-50d74b9ce7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90bf7793-fae7-4ef3-9365-50d74b9ce7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2708f5ff-0443-4df7-bd3e-2caee09bd2d5', 'volume_name': 'volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d5fbe3-8561-46b9-9b5c-2ded86a1fc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d5fbe3-8561-46b9-9b5c-2ded86a1fc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac9aabc-f8ec-4cb0-96b4-cc3b46423bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:07 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Volume 2708f5ff-0443-4df7-bd3e-2caee09bd2d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5', 'volume_size': 1} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1589571718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2708f5ff-0443-4df7-bd3e-2caee09bd2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12a2457bc4134f27babd977520fa7ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:34:07Z,use_quota=True,user_id='df1c7f632ad74e228af4584cae0d2e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Creating volume 2708f5ff-0443-4df7-bd3e-2caee09bd2d5 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:34:07 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] group_snapshot 8066f648-2afb-4df8-8643-4ac56e24891e: deleting {{(pid=94670) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 13 09:34:07 devstack sudo[110383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5 1073741824 Aug 13 09:34:07 devstack sudo[110383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "cinder-quobyte-84cbb05a-c8de-4869-8d52-ffef3593a38f" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-84cbb05a-c8de-4869-8d52-ffef3593a38f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "cinder-quobyte-92f6f33c-cb7b-417c-824b-8e83b8cc6421" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-92f6f33c-cb7b-417c-824b-8e83b8cc6421" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Deleting offline snapshot 92f6f33c-cb7b-417c-824b-8e83b8cc6421 of volume 84cbb05a-c8de-4869-8d52-ffef3593a38f {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] snapshot_file for this snap is: volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[66231142-94b3-4ff9-be44-eeb53ebce6ef]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:07 devstack sudo[110386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421 Aug 13 09:34:07 devstack sudo[110386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:07 devstack sudo[110386]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421" returned: 0 in 0.392s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84cbb05a-c8de-4869-8d52-ffef3593a38f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bdde5b-17a0-4b19-88ad-231203a8996b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:07 devstack sudo[110383]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5 1073741824" returned: 0 in 0.567s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:07 devstack sudo[110396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5 Aug 13 09:34:07 devstack sudo[110396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:07 devstack sudo[110395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f Aug 13 09:34:07 devstack sudo[110395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:08 devstack sudo[110396]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5" returned: 0 in 0.267s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac9aabc-f8ec-4cb0-96b4-cc3b46423bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393738c7-c115-4465-87ea-55e8de0f9627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:08 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Volume volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5 (2708f5ff-0443-4df7-bd3e-2caee09bd2d5): created successfully Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393738c7-c115-4465-87ea-55e8de0f9627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Flow 'volume_create_manager' (0db05bfa-5d08-4830-87a2-fa198c60a324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:34:08 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e988eb04-fce1-432b-b7ce-971b0edb5caa tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Created volume successfully. Aug 13 09:34:08 devstack sudo[110395]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f" returned: 0 in 0.410s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:08 devstack sudo[110403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421 Aug 13 09:34:08 devstack sudo[110403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:08 devstack sudo[110403]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421" returned: 0 in 0.343s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:08 devstack sudo[110408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421 Aug 13 09:34:08 devstack sudo[110408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:08 devstack sudo[110408]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f.92f6f33c-cb7b-417c-824b-8e83b8cc6421" returned: 0 in 0.260s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-92f6f33c-cb7b-417c-824b-8e83b8cc6421" released by "_delete_snapshot" :: held 1.501s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-84cbb05a-c8de-4869-8d52-ffef3593a38f" released by "delete_snapshot" :: held 1.523s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "cinder-quobyte-8d6a7631-ec02-4d1e-abcb-837e08541f10" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-8d6a7631-ec02-4d1e-abcb-837e08541f10" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "cinder-quobyte-cf2c3941-bcd8-44dd-b2ba-c86882441869" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-cf2c3941-bcd8-44dd-b2ba-c86882441869" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Deleting offline snapshot cf2c3941-bcd8-44dd-b2ba-c86882441869 of volume 8d6a7631-ec02-4d1e-abcb-837e08541f10 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] snapshot_file for this snap is: volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[435d057e-a1d4-4a2a-89fa-53b152cd9827]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:08 devstack sudo[110411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869 Aug 13 09:34:08 devstack sudo[110411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:09 devstack sudo[110411]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869" returned: 0 in 0.376s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:09 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d6a7631-ec02-4d1e-abcb-837e08541f10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:34:09 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e24dc0-bd13-4ffe-a17c-9bd6d81b6ebb]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:09 devstack sudo[110419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 Aug 13 09:34:09 devstack sudo[110419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:09 devstack sudo[110419]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10" returned: 0 in 0.390s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:09 devstack sudo[110424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869 Aug 13 09:34:09 devstack sudo[110424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:10 devstack sudo[110424]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869" returned: 0 in 0.391s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:10 devstack sudo[110462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869 Aug 13 09:34:10 devstack sudo[110462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-2454c5c5-2aa0-4381-8c7c-92d0edd3cb60 req-adcd490e-4229-497c-86e1-cdac64fd292c tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-2454c5c5-2aa0-4381-8c7c-92d0edd3cb60 req-adcd490e-4229-497c-86e1-cdac64fd292c tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:10 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[31195590-1c1e-46a0-986e-5a45561815ff]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-2454c5c5-2aa0-4381-8c7c-92d0edd3cb60 req-adcd490e-4229-497c-86e1-cdac64fd292c tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:10 devstack sudo[110464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5 Aug 13 09:34:10 devstack sudo[110464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:10 devstack sudo[110462]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10.cf2c3941-bcd8-44dd-b2ba-c86882441869" returned: 0 in 0.258s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-cf2c3941-bcd8-44dd-b2ba-c86882441869" released by "_delete_snapshot" :: held 1.514s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-8d6a7631-ec02-4d1e-abcb-837e08541f10" released by "delete_snapshot" :: held 1.535s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:10 devstack cinder-volume[94670]: WARNING cinder.quota [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1841914127 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1841914127, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:34:10 devstack cinder-volume[94670]: WARNING cinder.quota [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1841914127 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1841914127, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:34:10 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Created reservations ['2b01c584-e8d8-4307-8ee1-44816e7cc98a', '4a674075-9f82-4729-8224-349fc9e9d6b9', '119bd039-459d-4b77-a31e-c6536175e5f8', '8f7fe103-fb80-4819-a667-966bd5448b3a'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:34:10 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] Created reservations ['8e1c03e0-fbd5-47aa-b197-d34a2a0ac31a', 'ca89cf07-07e1-4bfe-898b-c73c35478a49', 'ff21365e-bad2-40dc-84df-3110198a25e4', '4f65cb5c-3429-4e30-8a19-3ef078a1fde1'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:34:10 devstack sudo[110464]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-2454c5c5-2aa0-4381-8c7c-92d0edd3cb60 req-adcd490e-4229-497c-86e1-cdac64fd292c tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5" returned: 0 in 0.447s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-2454c5c5-2aa0-4381-8c7c-92d0edd3cb60 req-adcd490e-4229-497c-86e1-cdac64fd292c tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.467s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:10 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-2454c5c5-2aa0-4381-8c7c-92d0edd3cb60 req-adcd490e-4229-497c-86e1-cdac64fd292c tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df963657-b3e7-43ee-a43a-2d1f0687913f', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:34:10 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-91988c05-a5b7-48ee-8be9-9caebc9a43f1 tempest-GroupSnapshotsTest-964973595 None] group_snapshot 8066f648-2afb-4df8-8643-4ac56e24891e: deleted successfully Aug 13 09:34:10 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-2454c5c5-2aa0-4381-8c7c-92d0edd3cb60 req-adcd490e-4229-497c-86e1-cdac64fd292c tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] attachment_update completed successfully. Aug 13 09:34:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "cinder-quobyte-84cbb05a-c8de-4869-8d52-ffef3593a38f" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-84cbb05a-c8de-4869-8d52-ffef3593a38f" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:12 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2743fc-dd65-4f1f-a55b-e0e87ab9d9a2]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:12 devstack sudo[110476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f Aug 13 09:34:12 devstack sudo[110476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:12 devstack sudo[110476]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f" returned: 0 in 0.377s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:12 devstack sudo[110481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f Aug 13 09:34:12 devstack sudo[110481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:12 devstack sudo[110481]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-84cbb05a-c8de-4869-8d52-ffef3593a38f" returned: 0 in 0.268s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-84cbb05a-c8de-4869-8d52-ffef3593a38f" released by "delete_volume" :: held 0.707s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "cinder-quobyte-8d6a7631-ec02-4d1e-abcb-837e08541f10" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-8d6a7631-ec02-4d1e-abcb-837e08541f10" acquired by "delete_volume" :: waited 0.020s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:12 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a69685-ecd2-4b7c-9445-0ccb922f98a1]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:12 devstack sudo[110484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 Aug 13 09:34:12 devstack sudo[110484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:13 devstack sudo[110484]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10" returned: 0 in 0.498s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:13 devstack sudo[110494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10 Aug 13 09:34:13 devstack sudo[110494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:13 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-d2a22892-b026-44f0-9cd7-d4b55043403e req-77285994-07e4-49b4-9d7f-a9d480a47db1 tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Terminate volume connection completed successfully. Aug 13 09:34:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-d2a22892-b026-44f0-9cd7-d4b55043403e req-77285994-07e4-49b4-9d7f-a9d480a47db1 tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Deleting attachment df963657-b3e7-43ee-a43a-2d1f0687913f. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:34:13 devstack sudo[110494]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d6a7631-ec02-4d1e-abcb-837e08541f10" returned: 0 in 0.287s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:13 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-8d6a7631-ec02-4d1e-abcb-837e08541f10" released by "delete_volume" :: held 0.867s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:13 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Created reservations ['bf5f720e-027d-4887-ba74-a8bdae5d48c8'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:34:13 devstack cinder-volume[94670]: WARNING cinder.quota [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1841914127 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1841914127, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:34:13 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Created reservations ['385fc0fe-6a78-4190-b041-4ec9c4283eb0', 'f69aa5e8-99d8-4530-adfc-717753de56dc', 'dbceb6a6-a18b-4f33-af0a-fa390bf4fd25', '66ea56ac-2a4f-4b1c-8597-b2244ad2b147'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:34:13 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Created reservations ['8ac2826b-675f-47c9-9ec6-cd9ee6a1c94e', '6078111a-0336-4462-8381-2ed31464e730', '37540657-77c7-4380-b40d-5bc4fa9d0fd8', '5e02949f-badb-431b-8ae6-a302d8ab0327'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:34:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:34:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:34:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:13 devstack sudo[110499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:34:13 devstack sudo[110499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Acquiring lock "cinder-2708f5ff-0443-4df7-bd3e-2caee09bd2d5-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Lock "cinder-2708f5ff-0443-4df7-bd3e-2caee09bd2d5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:14 devstack sudo[110499]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.303s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:14 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:34:14 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-9c547d7e-7432-4a24-9553-7a8667c021b3 tempest-GroupSnapshotsTest-964973595 None] Delete group completed successfully. Aug 13 09:34:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Acquiring lock "cinder-quobyte-2708f5ff-0443-4df7-bd3e-2caee09bd2d5" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Lock "cinder-quobyte-2708f5ff-0443-4df7-bd3e-2caee09bd2d5" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:14 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1517b13b-0d81-4165-ac01-a99e77252fba]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:14 devstack sudo[110502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5 Aug 13 09:34:14 devstack sudo[110502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5" returned: 0 in 0.492s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:14 devstack sudo[110502]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:14 devstack sudo[110507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5 Aug 13 09:34:14 devstack sudo[110507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:14 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-bef10d1e-b8f1-4979-b00e-d5955258467e tempest-GroupSnapshotsTest-964973595 None] Group tempest-GroupSnapshotsTest-Group-189860066: creating Aug 13 09:34:14 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-bef10d1e-b8f1-4979-b00e-d5955258467e tempest-GroupSnapshotsTest-964973595 None] Group tempest-GroupSnapshotsTest-Group-189860066: created successfully Aug 13 09:34:14 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-bef10d1e-b8f1-4979-b00e-d5955258467e tempest-GroupSnapshotsTest-964973595 None] Create group completed successfully. Aug 13 09:34:15 devstack sudo[110507]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2708f5ff-0443-4df7-bd3e-2caee09bd2d5" returned: 0 in 0.276s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Lock "cinder-quobyte-2708f5ff-0443-4df7-bd3e-2caee09bd2d5" released by "delete_volume" :: held 0.825s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:15 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=126,cinder:UPDATE=123,cinder:INSERT=31,cinder:DELETE=7 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:34:15 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Created reservations ['815d710f-6743-40a1-99f6-697a1b45bd3e', '035c6c09-ef53-4a9d-9d90-c17063a21b27', '1dd70521-d9e1-4b61-b52a-480dab1751a2', 'ccf39cac-dda6-4e3f-84c1-ec2c60709d03'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:34:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:34:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:34:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:15 devstack sudo[110510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:34:15 devstack sudo[110510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:15 devstack sudo[110510]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.296s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:15 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:34:15 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Deleted volume successfully. Aug 13 09:34:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2aba77c3-c0cf-41c6-b599-a2f604ed98dc tempest-TestServerVolumeAttachScenarioOldVersion-1444182339 None] Lock "cinder-2708f5ff-0443-4df7-bd3e-2caee09bd2d5-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:16 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=146,cinder:SELECT=140,cinder:INSERT=31,cinder:DELETE=5 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:34:16 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:34:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Flow 'volume_create_manager' (ccf2fda8-19da-47a8-9624-a68821f44e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:34:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740017bf-449d-42c1-a87c-e9e7a9bac72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740017bf-449d-42c1-a87c-e9e7a9bac72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1970169967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1af5bdd8-825c-4db3-ba50-e5059997bab9,host='devstack@QuobyteHD#QuobyteHD',id=48d21792-32a5-4ba6-845b-40f926fb287e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852f43863a9543e2a6cdaca06883a3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:34:17Z,use_quota=True,user_id='ea74ed8c6d774b0baa67aaacc7ae0c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41661290-6e14-49e7-aede-d76ab589f344),volume_type_id=41661290-6e14-49e7-aede-d76ab589f344)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19484215-811e-49d2-99d5-b8950808d220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19484215-811e-49d2-99d5-b8950808d220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cd138a-966e-4ebb-a84c-3692722f7ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cd138a-966e-4ebb-a84c-3692722f7ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d21792-32a5-4ba6-845b-40f926fb287e', 'volume_name': 'volume-48d21792-32a5-4ba6-845b-40f926fb287e', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4d9103-8b50-4b7e-ae4e-98615b04b191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4d9103-8b50-4b7e-ae4e-98615b04b191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33ed61b-541a-4c94-80cb-c8ceb403c82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:17 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Volume 48d21792-32a5-4ba6-845b-40f926fb287e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d21792-32a5-4ba6-845b-40f926fb287e', 'volume_size': 1} Aug 13 09:34:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1af5bdd8-825c-4db3-ba50-e5059997bab9,created_at=2026-08-13T07:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1970169967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1af5bdd8-825c-4db3-ba50-e5059997bab9,host='devstack@QuobyteHD#QuobyteHD',id=48d21792-32a5-4ba6-845b-40f926fb287e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852f43863a9543e2a6cdaca06883a3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:34:17Z,use_quota=True,user_id='ea74ed8c6d774b0baa67aaacc7ae0c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41661290-6e14-49e7-aede-d76ab589f344),volume_type_id=41661290-6e14-49e7-aede-d76ab589f344)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:34:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Creating volume 48d21792-32a5-4ba6-845b-40f926fb287e {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:34:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:34:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:34:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:34:17 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:34:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:17 devstack sudo[110542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e 1073741824 Aug 13 09:34:17 devstack sudo[110542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:17 devstack sudo[110542]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e 1073741824" returned: 0 in 0.709s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:17 devstack sudo[110552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e Aug 13 09:34:17 devstack sudo[110552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:18 devstack sudo[110552]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e" returned: 0 in 0.437s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:34:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33ed61b-541a-4c94-80cb-c8ceb403c82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d21792-32a5-4ba6-845b-40f926fb287e', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c96ab58-5c49-4964-96a0-6824dd891f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:18 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Volume volume-48d21792-32a5-4ba6-845b-40f926fb287e (48d21792-32a5-4ba6-845b-40f926fb287e): created successfully Aug 13 09:34:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c96ab58-5c49-4964-96a0-6824dd891f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Flow 'volume_create_manager' (ccf2fda8-19da-47a8-9624-a68821f44e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:34:18 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-32c8c4c8-98bd-41d3-906e-fb45a4c8b2ed tempest-GroupSnapshotsTest-964973595 None] Created volume successfully. Aug 13 09:34:19 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-720085b0-2aea-4222-a191-baec9263a0eb req-d3def6c5-90fe-4786-aa66-47dc977d868e tempest-TestShelveInstance-59204464 None] Terminate volume connection completed successfully. Aug 13 09:34:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-720085b0-2aea-4222-a191-baec9263a0eb req-d3def6c5-90fe-4786-aa66-47dc977d868e tempest-TestShelveInstance-59204464 None] Deleting attachment f006e77a-10b1-4b58-8713-41d9516a3b2c. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:34:19 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] GroupSnapshot 0c53f3af-ea82-4a12-98cc-28c79966bdd3: creating. Aug 13 09:34:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] Group snapshot 0c53f3af-ea82-4a12-98cc-28c79966bdd3: creating. {{(pid=94670) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 13 09:34:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] Creating offline snapshot 11b958e7-fb64-4b63-a572-dc7ed85e12a1 of volume 48d21792-32a5-4ba6-845b-40f926fb287e {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:34:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Acquiring lock "cinder-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:19 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef65fa0f-859b-4f54-91bf-e32504bf366b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Lock "cinder-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Acquiring lock "cinder-quobyte-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Lock "cinder-quobyte-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0" acquired by "delete_volume" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:20 devstack sudo[110582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e Aug 13 09:34:20 devstack sudo[110582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:20 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[636311ca-9474-4a97-9980-7cda0dd97ecd]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:20 devstack sudo[110584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 Aug 13 09:34:20 devstack sudo[110584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:20 devstack sudo[110582]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e" returned: 0 in 0.511s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:20 devstack sudo[110590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1 1G Aug 13 09:34:20 devstack sudo[110590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:20 devstack sudo[110584]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0" returned: 0 in 0.515s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:20 devstack sudo[110594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 Aug 13 09:34:20 devstack sudo[110594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:21 devstack sudo[110590]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1 1G" returned: 0 in 0.598s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48d21792-32a5-4ba6-845b-40f926fb287e -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:21 devstack sudo[110603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48d21792-32a5-4ba6-845b-40f926fb287e -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1 Aug 13 09:34:21 devstack sudo[110603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:21 devstack sudo[110594]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0" returned: 1 in 0.483s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:21 devstack sudo[110605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0 Aug 13 09:34:21 devstack sudo[110605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:21 devstack sudo[110605]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0" returned: 0 in 0.401s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:21 devstack sudo[110603]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48d21792-32a5-4ba6-845b-40f926fb287e -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1" returned: 0 in 0.479s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:21 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1 is being set with open permissions: ugo+rw: NotImplementedError Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Lock "cinder-quobyte-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0" released by "delete_volume" :: held 1.497s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:21 devstack sudo[110613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1 Aug 13 09:34:21 devstack sudo[110613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG cinder.quota [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Created reservations ['3a6ef79e-ecff-4e3a-ba77-0ba0963741c4', '400f3fcc-55ea-4224-b2dc-bfb04a157e8a', 'a035330e-c4c4-46d6-a8e1-ffe27242855c', '185e3634-9b07-414c-98af-27a1c6d7d732'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:21 devstack sudo[110615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:34:21 devstack sudo[110615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:21 devstack sudo[110613]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1" returned: 0 in 0.327s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:21 devstack sudo[110618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.info Aug 13 09:34:21 devstack sudo[110618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:22 devstack sudo[110615]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.308s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:22 devstack cinder-volume[94670]: DEBUG cinder.manager [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:34:22 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Deleted volume successfully. Aug 13 09:34:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [req-720085b0-2aea-4222-a191-baec9263a0eb req-688da1d5-15f0-4a1b-9f3a-f0d47f9bd92e tempest-TestShelveInstance-59204464 None] Lock "cinder-49a7f92d-ed20-4fe2-80d6-7c2d1897c5d0-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:22 devstack sudo[110618]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.info" returned: 0 in 0.347s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:22 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.info is being set with open permissions: ugo+rw: NotImplementedError Aug 13 09:34:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:22 devstack sudo[110623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.info Aug 13 09:34:22 devstack sudo[110623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:22 devstack sudo[110623]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.info" returned: 0 in 0.337s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.696s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:22 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-15cc217c-413d-4278-a0bc-7ee34d012e56 tempest-GroupSnapshotsTest-964973595 None] group_snapshot 0c53f3af-ea82-4a12-98cc-28c79966bdd3: created successfully Aug 13 09:34:23 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] group_snapshot 0c53f3af-ea82-4a12-98cc-28c79966bdd3: deleting Aug 13 09:34:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] group_snapshot 0c53f3af-ea82-4a12-98cc-28c79966bdd3: deleting {{(pid=94670) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 13 09:34:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "cinder-quobyte-48d21792-32a5-4ba6-845b-40f926fb287e" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-48d21792-32a5-4ba6-845b-40f926fb287e" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "cinder-quobyte-11b958e7-fb64-4b63-a572-dc7ed85e12a1" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-11b958e7-fb64-4b63-a572-dc7ed85e12a1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] Deleting offline snapshot 11b958e7-fb64-4b63-a572-dc7ed85e12a1 of volume 48d21792-32a5-4ba6-845b-40f926fb287e {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:34:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] snapshot_file for this snap is: volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:34:23 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec107839-7178-49dc-aa87-983f19943df2]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:23 devstack sudo[110629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1 Aug 13 09:34:23 devstack sudo[110629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:23 devstack sudo[110629]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1" returned: 0 in 0.421s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48d21792-32a5-4ba6-845b-40f926fb287e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:34:23 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[940a8635-57f4-46f2-acf3-25b78d8cb563]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:24 devstack sudo[110634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e Aug 13 09:34:24 devstack sudo[110634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:24 devstack sudo[110634]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e" returned: 0 in 0.362s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:24 devstack sudo[110639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1 Aug 13 09:34:24 devstack sudo[110639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:24 devstack sudo[110639]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1" returned: 0 in 0.512s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:24 devstack sudo[110645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1 Aug 13 09:34:24 devstack sudo[110645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:25 devstack sudo[110645]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e.11b958e7-fb64-4b63-a572-dc7ed85e12a1" returned: 0 in 0.292s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-11b958e7-fb64-4b63-a572-dc7ed85e12a1" released by "_delete_snapshot" :: held 1.710s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-48d21792-32a5-4ba6-845b-40f926fb287e" released by "delete_snapshot" :: held 1.739s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:25 devstack cinder-volume[94670]: WARNING cinder.quota [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1387520009 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1387520009, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:34:25 devstack cinder-volume[94670]: WARNING cinder.quota [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1387520009 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1387520009, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:34:25 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] Created reservations ['e7b331fa-5d7c-4539-a52e-376cb37c9690', '6ad79cad-7411-4dd3-88ee-8278ef831adf', '74bcf79d-8071-4d4d-a806-aa0aa74674a6', 'ac606459-c469-4b85-90e6-38b6c859ca38'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:34:25 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d138c97a-005a-43c9-b587-c2272bdef0ff tempest-GroupSnapshotsTest-964973595 None] group_snapshot 0c53f3af-ea82-4a12-98cc-28c79966bdd3: deleted successfully Aug 13 09:34:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "cinder-quobyte-48d21792-32a5-4ba6-845b-40f926fb287e" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-48d21792-32a5-4ba6-845b-40f926fb287e" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:26 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cae41f-fbc7-4a4c-82d6-bf0777a7b86a]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:26 devstack sudo[110649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e Aug 13 09:34:26 devstack sudo[110649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:26 devstack sudo[110649]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e" returned: 0 in 0.479s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:26 devstack sudo[110654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e Aug 13 09:34:26 devstack sudo[110654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:27 devstack sudo[110654]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-48d21792-32a5-4ba6-845b-40f926fb287e" returned: 0 in 0.304s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Lock "cinder-quobyte-48d21792-32a5-4ba6-845b-40f926fb287e" released by "delete_volume" :: held 0.877s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:27 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Created reservations ['be2adf26-0bca-40de-a33f-89aa407c4f47'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:34:27 devstack cinder-volume[94670]: WARNING cinder.quota [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1387520009 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1387520009, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:34:27 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Created reservations ['23d4563a-748c-4508-943b-33cdd11ab093', 'e97d9c28-a6de-4fe1-bf58-d805f8584b9b', 'c558817a-059a-487f-a963-080517dd8f7c', 'e39c389c-370d-4772-9cfc-bfbcd3171fd2'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:34:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:34:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:34:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:27 devstack sudo[110658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:34:27 devstack sudo[110658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:27 devstack sudo[110658]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.332s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:27 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:34:27 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-7e308dc2-1244-46a1-918a-088b7baa1856 tempest-GroupSnapshotsTest-964973595 None] Delete group completed successfully. Aug 13 09:34:36 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-66eb0544-2971-479f-b33e-277867762afd tempest-GroupSnapshotsV319Test-143546900 None] Group tempest-GroupSnapshotsV319Test-Group-644196080: creating Aug 13 09:34:36 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-66eb0544-2971-479f-b33e-277867762afd tempest-GroupSnapshotsV319Test-143546900 None] Group tempest-GroupSnapshotsV319Test-Group-644196080: created successfully Aug 13 09:34:36 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-66eb0544-2971-479f-b33e-277867762afd tempest-GroupSnapshotsV319Test-143546900 None] Create group completed successfully. Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Flow 'volume_create_manager' (2eb02180-0cc4-44f0-b3cd-e50aef2548a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71cc404-5348-4486-a17a-5893c49b84e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71cc404-5348-4486-a17a-5893c49b84e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821905766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1680143-00be-4c85-9cd6-8c0f08cf71a2,host='devstack@QuobyteHD#QuobyteHD',id=9736539a-d5d2-4be5-8c56-ba96d355caab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ca9ef7552c4a5c8803b57d58fb81c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:34:38Z,use_quota=True,user_id='cf5629086f764c2daf2daf890e7abae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ed9f694-7c08-458c-b006-a88b70a69684),volume_type_id=3ed9f694-7c08-458c-b006-a88b70a69684)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b4c127-43fb-4990-bc43-8493eaeeb6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b4c127-43fb-4990-bc43-8493eaeeb6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe6b7a5-ea51-4345-a820-612f63a2bb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe6b7a5-ea51-4345-a820-612f63a2bb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9736539a-d5d2-4be5-8c56-ba96d355caab', 'volume_name': 'volume-9736539a-d5d2-4be5-8c56-ba96d355caab', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff94c51-8a1f-458f-bf02-177591b7d40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff94c51-8a1f-458f-bf02-177591b7d40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71d6986-39d2-40cc-85d1-40a380ff0e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:38 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Volume 9736539a-d5d2-4be5-8c56-ba96d355caab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9736539a-d5d2-4be5-8c56-ba96d355caab', 'volume_size': 1} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d1680143-00be-4c85-9cd6-8c0f08cf71a2,created_at=2026-08-13T07:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821905766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1680143-00be-4c85-9cd6-8c0f08cf71a2,host='devstack@QuobyteHD#QuobyteHD',id=9736539a-d5d2-4be5-8c56-ba96d355caab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ca9ef7552c4a5c8803b57d58fb81c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:34:38Z,use_quota=True,user_id='cf5629086f764c2daf2daf890e7abae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ed9f694-7c08-458c-b006-a88b70a69684),volume_type_id=3ed9f694-7c08-458c-b006-a88b70a69684)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Creating volume 9736539a-d5d2-4be5-8c56-ba96d355caab {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:34:38 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:38 devstack sudo[110708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab 1073741824 Aug 13 09:34:38 devstack sudo[110708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:38 devstack sudo[110708]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab 1073741824" returned: 0 in 0.538s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:38 devstack sudo[110713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab Aug 13 09:34:38 devstack sudo[110713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:39 devstack sudo[110713]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab" returned: 0 in 0.277s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:34:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71d6986-39d2-40cc-85d1-40a380ff0e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9736539a-d5d2-4be5-8c56-ba96d355caab', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05dd9c5b-ff9f-4fe8-a8a1-0a3518894013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:39 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Volume volume-9736539a-d5d2-4be5-8c56-ba96d355caab (9736539a-d5d2-4be5-8c56-ba96d355caab): created successfully Aug 13 09:34:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05dd9c5b-ff9f-4fe8-a8a1-0a3518894013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Flow 'volume_create_manager' (2eb02180-0cc4-44f0-b3cd-e50aef2548a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:34:39 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-bccefad1-581a-4dd0-9180-9f9157a3417d tempest-GroupSnapshotsV319Test-143546900 None] Created volume successfully. Aug 13 09:34:39 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] GroupSnapshot 834d84e9-279f-421a-b222-96dab65b4332: creating. Aug 13 09:34:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] Group snapshot 834d84e9-279f-421a-b222-96dab65b4332: creating. {{(pid=94670) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 13 09:34:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] Creating offline snapshot 355b4595-dcaa-4722-8d77-cb7d5affaed6 of volume 9736539a-d5d2-4be5-8c56-ba96d355caab {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:34:39 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1899b4f-b2ba-4abe-bda3-e83f129e3fb0]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:39 devstack sudo[110717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab Aug 13 09:34:39 devstack sudo[110717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:40 devstack sudo[110717]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Flow 'volume_create_manager' (fa821ac6-c20c-4648-ad6a-17fb5dc62847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b39890-d740-45a7-825f-d5c4f3e3d76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab" returned: 0 in 0.467s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:40 devstack sudo[110723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6 1G Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b39890-d740-45a7-825f-d5c4f3e3d76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a40ee7-d778-4efc-bc8d-5e1171c53b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d02e6917ca4599b154d9210b3c1133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:34:40Z,use_quota=True,user_id='205208d4360f4d32a7309a4d5ccee7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:40 devstack sudo[110723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f170d45-273f-47f8-8c17-3a8a3c72e1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f170d45-273f-47f8-8c17-3a8a3c72e1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2dae53-8ddf-4d27-bc73-264d0db9c68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG cinder.image.glance [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Creating Keystone auth plugin from conf {{(pid=94670) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2dae53-8ddf-4d27-bc73-264d0db9c68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65a40ee7-d778-4efc-bc8d-5e1171c53b3b', 'volume_name': 'volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b', 'volume_size': 1, 'image_id': '42ea5702-bfdc-4945-aab1-cd97867dce85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42ea5702-bfdc-4945-aab1-cd97867dce85', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b023cf4f94e9b799af67d66adcd1f46', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f1d02e6917ca4599b154d9210b3c1133', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b52c1a5d3e225f0e52d841bd93fdce29830a1a7d777d51b6952cd43f125d509e24671efe415f54857ddda93ebb3b12884949b63dc93f129010ade8ba1a30556c', 'id': '42ea5702-bfdc-4945-aab1-cd97867dce85', 'created_at': datetime.datetime(2026, 8, 13, 7, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42ea5702-bfdc-4945-aab1-cd97867dce85/file', 'properties': {}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e0958f-5f03-4216-bf9e-8068518c7373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e0958f-5f03-4216-bf9e-8068518c7373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78da0287-0ba6-4d84-9228-5f5e81f18fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:40 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Volume 65a40ee7-d778-4efc-bc8d-5e1171c53b3b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b', 'volume_size': 1, 'image_id': '42ea5702-bfdc-4945-aab1-cd97867dce85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42ea5702-bfdc-4945-aab1-cd97867dce85', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b023cf4f94e9b799af67d66adcd1f46', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f1d02e6917ca4599b154d9210b3c1133', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b52c1a5d3e225f0e52d841bd93fdce29830a1a7d777d51b6952cd43f125d509e24671efe415f54857ddda93ebb3b12884949b63dc93f129010ade8ba1a30556c', 'id': '42ea5702-bfdc-4945-aab1-cd97867dce85', 'created_at': datetime.datetime(2026, 8, 13, 7, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42ea5702-bfdc-4945-aab1-cd97867dce85/file', 'properties': {}}, 'image_service': } Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Trying to clone 65a40ee7-d778-4efc-bc8d-5e1171c53b3b from image 42ea5702-bfdc-4945-aab1-cd97867dce85 at location (None, [{'url': 'file:///opt/stack/data/glance/images/42ea5702-bfdc-4945-aab1-cd97867dce85', 'metadata': {}}]). {{(pid=94670) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 13 09:34:40 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Image download 0.00 MB at 0.00 MB/s Aug 13 09:34:40 devstack sudo[110723]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6 1G" returned: 0 in 0.607s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9736539a-d5d2-4be5-8c56-ba96d355caab -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:40 devstack sudo[110728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9736539a-d5d2-4be5-8c56-ba96d355caab -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6 Aug 13 09:34:40 devstack sudo[110728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b5ed71-c466-4dc7-bc6a-5d032e69f34a]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:41 devstack sudo[110730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD Aug 13 09:34:41 devstack sudo[110730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:41 devstack sudo[110728]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9736539a-d5d2-4be5-8c56-ba96d355caab -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6" returned: 0 in 0.362s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:41 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6 is being set with open permissions: ugo+rw: NotImplementedError Aug 13 09:34:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:41 devstack sudo[110735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6 Aug 13 09:34:41 devstack sudo[110735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:41 devstack sudo[110730]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:41 devstack sudo[110739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD Aug 13 09:34:41 devstack sudo[110739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:41 devstack sudo[110735]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6" returned: 0 in 0.274s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:41 devstack sudo[110742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.info Aug 13 09:34:41 devstack sudo[110742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:41 devstack sudo[110739]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:34:41 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Temporary image 42ea5702-bfdc-4945-aab1-cd97867dce85 is fetched for user 205208d4360f4d32a7309a4d5ccee7cc. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 13 09:34:41 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bfb351-24ff-49d9-864d-77525251112c]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:41 devstack sudo[110742]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.info" returned: 0 in 0.272s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:41 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.info is being set with open permissions: ugo+rw: NotImplementedError Aug 13 09:34:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:41 devstack sudo[110749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.info Aug 13 09:34:41 devstack sudo[110749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:41 devstack sudo[110747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD Aug 13 09:34:41 devstack sudo[110747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:42 devstack sudo[110749]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.info" returned: 0 in 0.364s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.439s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:42 devstack sudo[110747]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:42 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-92da99cd-fa61-49a5-bfca-6cc09f310c67 tempest-GroupSnapshotsV319Test-143546900 None] group_snapshot 834d84e9-279f-421a-b222-96dab65b4332: created successfully Aug 13 09:34:42 devstack sudo[110755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD Aug 13 09:34:42 devstack sudo[110755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:42 devstack sudo[110755]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a40ee7-d778-4efc-bc8d-5e1171c53b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d02e6917ca4599b154d9210b3c1133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:34:40Z,use_quota=True,user_id='205208d4360f4d32a7309a4d5ccee7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Creating volume 65a40ee7-d778-4efc-bc8d-5e1171c53b3b {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:34:42 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:34:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:42 devstack sudo[110760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b 1073741824 Aug 13 09:34:42 devstack sudo[110760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:43 devstack sudo[110760]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b 1073741824" returned: 0 in 0.528s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:43 devstack sudo[110766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:34:43 devstack sudo[110766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:43 devstack sudo[110768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b Aug 13 09:34:43 devstack sudo[110768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:43 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] group_snapshot 834d84e9-279f-421a-b222-96dab65b4332: deleting Aug 13 09:34:43 devstack sudo[110766]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.337s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] group_snapshot 834d84e9-279f-421a-b222-96dab65b4332: deleting {{(pid=94670) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] Acquiring lock "cinder-quobyte-9736539a-d5d2-4be5-8c56-ba96d355caab" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] Lock "cinder-quobyte-9736539a-d5d2-4be5-8c56-ba96d355caab" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] Acquiring lock "cinder-quobyte-355b4595-dcaa-4722-8d77-cb7d5affaed6" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:43 devstack sudo[110768]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] Lock "cinder-quobyte-355b4595-dcaa-4722-8d77-cb7d5affaed6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] Deleting offline snapshot 355b4595-dcaa-4722-8d77-cb7d5affaed6 of volume 9736539a-d5d2-4be5-8c56-ba96d355caab {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] snapshot_file for this snap is: volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b" returned: 0 in 0.415s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[473f75af-919a-425f-9c1f-ec4e4dfbde00]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Attempting download of 42ea5702-bfdc-4945-aab1-cd97867dce85 ((None, [{'url': 'file:///opt/stack/data/glance/images/42ea5702-bfdc-4945-aab1-cd97867dce85', 'metadata': {}}])) to volume 65a40ee7-d778-4efc-bc8d-5e1171c53b3b. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f458c60-e9ca-4037-b0cb-679c757e24a1]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42ea5702-bfdc-4945-aab1-cd97867dce85_b3prv5mn {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:43 devstack sudo[110772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6 Aug 13 09:34:43 devstack sudo[110772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:43 devstack sudo[110773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42ea5702-bfdc-4945-aab1-cd97867dce85_b3prv5mn Aug 13 09:34:43 devstack sudo[110773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:44 devstack sudo[110772]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6" returned: 0 in 0.440s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9736539a-d5d2-4be5-8c56-ba96d355caab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:34:44 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39619d5-f506-4da7-825a-1e4f60f49c54]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:44 devstack sudo[110773]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42ea5702-bfdc-4945-aab1-cd97867dce85_b3prv5mn" returned: 0 in 0.431s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42ea5702-bfdc-4945-aab1-cd97867dce85_b3prv5mn {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:44 devstack sudo[110782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab Aug 13 09:34:44 devstack sudo[110782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:44 devstack sudo[110784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42ea5702-bfdc-4945-aab1-cd97867dce85_b3prv5mn Aug 13 09:34:44 devstack sudo[110784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:44 devstack sudo[110784]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42ea5702-bfdc-4945-aab1-cd97867dce85_b3prv5mn" returned: 1 in 0.417s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42ea5702-bfdc-4945-aab1-cd97867dce85_b3prv5mn' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:34:44 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c79a8a9-bd9c-49e0-9bff-55b70a03c428]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:44 devstack sudo[110782]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab" returned: 0 in 0.496s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:44 devstack sudo[110793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6 Aug 13 09:34:44 devstack sudo[110793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:44 devstack sudo[110792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD Aug 13 09:34:44 devstack sudo[110792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:45 devstack sudo[110793]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6" returned: 0 in 0.417s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:45 devstack sudo[110792]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:45 devstack sudo[110802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6 Aug 13 09:34:45 devstack sudo[110802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:45 devstack sudo[110804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD Aug 13 09:34:45 devstack sudo[110804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:45 devstack sudo[110802]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab.355b4595-dcaa-4722-8d77-cb7d5affaed6" returned: 0 in 0.273s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] Lock "cinder-quobyte-355b4595-dcaa-4722-8d77-cb7d5affaed6" released by "_delete_snapshot" :: held 1.757s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] Lock "cinder-quobyte-9736539a-d5d2-4be5-8c56-ba96d355caab" released by "delete_snapshot" :: held 1.791s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:45 devstack cinder-volume[94670]: WARNING cinder.quota [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1744282553 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1744282553, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:34:45 devstack cinder-volume[94670]: WARNING cinder.quota [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1744282553 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1744282553, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:34:45 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] Created reservations ['1171b21a-a188-45e0-9f1a-f890a7d5305c', '140667dd-28a2-4fec-b9ac-2367490e0f7e', '957b41c7-1ffc-463e-a919-b4a13ff9a398', 'd39e1ffc-4ce6-49d4-8209-bbd7961c73a1'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:34:45 devstack sudo[110804]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD" returned: 1 in 0.434s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:34:45 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] 42ea5702-bfdc-4945-aab1-cd97867dce85 was raw, converting to raw {{(pid=94670) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 13 09:34:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:45 devstack sudo[110810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b Aug 13 09:34:45 devstack sudo[110810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:45 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-eaf823b5-f2c2-4e76-aab0-f2a9bdde86eb tempest-GroupSnapshotsV319Test-143546900 None] group_snapshot 834d84e9-279f-421a-b222-96dab65b4332: deleted successfully Aug 13 09:34:45 devstack sudo[110810]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b" returned: 0 in 0.395s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:45 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_42ea5702-bfdc-4945-aab1-cd97867dce85_xzakf4ecdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:34:45 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Converted 0.00 MB image at 0.00 MB/s Aug 13 09:34:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:45 devstack sudo[110815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b 1G Aug 13 09:34:45 devstack sudo[110815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Acquiring lock "cinder-quobyte-9736539a-d5d2-4be5-8c56-ba96d355caab" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Lock "cinder-quobyte-9736539a-d5d2-4be5-8c56-ba96d355caab" acquired by "delete_volume" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:46 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff246a5e-7cdd-47ce-80ec-ab0cb19bc919]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:46 devstack sudo[110815]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b 1G" returned: 0 in 0.322s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:46 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f596335-904a-46fc-9754-b30e508ff8d6]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:46 devstack sudo[110820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab Aug 13 09:34:46 devstack sudo[110820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:46 devstack sudo[110821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b Aug 13 09:34:46 devstack sudo[110821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:46 devstack sudo[110820]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab" returned: 0 in 0.385s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:46 devstack sudo[110827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab Aug 13 09:34:46 devstack sudo[110827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:46 devstack sudo[110821]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b" returned: 0 in 0.388s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:46 devstack sudo[110831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b Aug 13 09:34:46 devstack sudo[110831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:46 devstack sudo[110827]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9736539a-d5d2-4be5-8c56-ba96d355caab" returned: 0 in 0.281s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Lock "cinder-quobyte-9736539a-d5d2-4be5-8c56-ba96d355caab" released by "delete_volume" :: held 0.739s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Created reservations ['4a922940-9c9c-4073-8c78-72ec236b9746'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:34:47 devstack cinder-volume[94670]: WARNING cinder.quota [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1744282553 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1744282553, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Created reservations ['feab9dd6-964a-4fa2-af1c-76578303b573', '75b77201-3409-444c-b24b-5d9c54e246d1', 'bb9b0bae-4eef-4f48-86f6-485930c93970', 'dab9396c-5cec-4800-9fc5-2db8d00a6f7d'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:34:47 devstack sudo[110831]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b" returned: 1 in 0.416s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Downloaded image 42ea5702-bfdc-4945-aab1-cd97867dce85 ((None, [{'url': 'file:///opt/stack/data/glance/images/42ea5702-bfdc-4945-aab1-cd97867dce85', 'metadata': {}}])) to volume 65a40ee7-d778-4efc-bc8d-5e1171c53b3b successfully. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Temporary image 42ea5702-bfdc-4945-aab1-cd97867dce85 for user 205208d4360f4d32a7309a4d5ccee7cc is deleted. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Marking volume 65a40ee7-d778-4efc-bc8d-5e1171c53b3b as bootable. {{(pid=94670) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Copying metadata from image 42ea5702-bfdc-4945-aab1-cd97867dce85 to 65a40ee7-d778-4efc-bc8d-5e1171c53b3b. {{(pid=94670) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Creating volume glance metadata for volume 65a40ee7-d778-4efc-bc8d-5e1171c53b3b backed by image 42ea5702-bfdc-4945-aab1-cd97867dce85 with: {'image_id': '42ea5702-bfdc-4945-aab1-cd97867dce85', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6b023cf4f94e9b799af67d66adcd1f46', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94670) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78da0287-0ba6-4d84-9228-5f5e81f18fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b', 'volume_size': 1, 'image_id': '42ea5702-bfdc-4945-aab1-cd97867dce85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42ea5702-bfdc-4945-aab1-cd97867dce85', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b023cf4f94e9b799af67d66adcd1f46', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f1d02e6917ca4599b154d9210b3c1133', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b52c1a5d3e225f0e52d841bd93fdce29830a1a7d777d51b6952cd43f125d509e24671efe415f54857ddda93ebb3b12884949b63dc93f129010ade8ba1a30556c', 'id': '42ea5702-bfdc-4945-aab1-cd97867dce85', 'created_at': datetime.datetime(2026, 8, 13, 7, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42ea5702-bfdc-4945-aab1-cd97867dce85/file', 'properties': {}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:47 devstack sudo[110837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8a315e-cd46-4fdf-9589-69e910079077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:34:47 devstack sudo[110837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:47 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Volume volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b (65a40ee7-d778-4efc-bc8d-5e1171c53b3b): created successfully Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8a315e-cd46-4fdf-9589-69e910079077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Flow 'volume_create_manager' (fa821ac6-c20c-4648-ad6a-17fb5dc62847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:34:47 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-2bbc9338-3a22-46c6-8474-7c7e16ee1ea6 tempest-VolumeImageDependencyTests-393835600 None] Created volume successfully. Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.360s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:34:47 devstack sudo[110837]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:47 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-f61df51c-6fcd-4aa5-963f-92873e2f7eb2 tempest-GroupSnapshotsV319Test-143546900 None] Delete group completed successfully. Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Acquiring lock "cinder-65a40ee7-d778-4efc-bc8d-5e1171c53b3b-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Lock "cinder-65a40ee7-d778-4efc-bc8d-5e1171c53b3b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Acquiring lock "cinder-quobyte-65a40ee7-d778-4efc-bc8d-5e1171c53b3b" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Lock "cinder-quobyte-65a40ee7-d778-4efc-bc8d-5e1171c53b3b" acquired by "delete_volume" :: waited 0.020s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7dd33c-eafe-4951-ba94-a8a5b586d62a]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:34:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:48 devstack sudo[110840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b Aug 13 09:34:48 devstack sudo[110840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:48 devstack sudo[110840]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b" returned: 0 in 0.421s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:48 devstack sudo[110844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b Aug 13 09:34:48 devstack sudo[110844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:48 devstack sudo[110844]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b" returned: 1 in 0.488s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:34:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:48 devstack sudo[110849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b Aug 13 09:34:48 devstack sudo[110849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:49 devstack sudo[110849]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-65a40ee7-d778-4efc-bc8d-5e1171c53b3b" returned: 0 in 0.319s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Lock "cinder-quobyte-65a40ee7-d778-4efc-bc8d-5e1171c53b3b" released by "delete_volume" :: held 1.312s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:49 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Created reservations ['b181cc02-3c36-4276-9b0f-6630578de8d7', '1843f8f0-aea1-435f-b8ce-52278fcd319e', '4991d78f-62fd-4033-9916-3784caafd814', 'e1877c20-dba5-407c-85b6-0bd120060101'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:34:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:34:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:34:49 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:34:49 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:34:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:34:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:34:49 devstack sudo[110852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:34:49 devstack sudo[110852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:34:49 devstack sudo[110852]: pam_unix(sudo:session): session closed for user root Aug 13 09:34:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.310s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:34:49 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:34:49 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Deleted volume successfully. Aug 13 09:34:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21519e5a-76e2-42c7-a5d2-355cca425a84 tempest-VolumeImageDependencyTests-393835600 None] Lock "cinder-65a40ee7-d778-4efc-bc8d-5e1171c53b3b-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:34:59 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=83,cinder:SELECT=68,cinder:DELETE=2,cinder:INSERT=17 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:34:59 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=58,cinder:SELECT=66,cinder:DELETE=4,cinder:INSERT=23 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Flow 'volume_create_manager' (276b22bc-be9c-41c9-8df5-8494931da4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b3d996-27cf-4b19-98e4-1f6a89fec38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b3d996-27cf-4b19-98e4-1f6a89fec38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-781442260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be21228c-a653-4e08-ac38-251cdad1889d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95db0791e6f41d0be0ac732952a39c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:35:05Z,use_quota=True,user_id='0abe94bea82d4527935eeae009a0ff9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50492a74-dc49-470f-882e-307b7026a07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50492a74-dc49-470f-882e-307b7026a07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffa260d-6975-4ac8-b22f-4518b5a86862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffa260d-6975-4ac8-b22f-4518b5a86862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be21228c-a653-4e08-ac38-251cdad1889d', 'volume_name': 'volume-be21228c-a653-4e08-ac38-251cdad1889d', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce295b0-28df-400b-bf25-ed895f01678a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce295b0-28df-400b-bf25-ed895f01678a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f512342b-b56b-4d54-b11f-d6dbb73034ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:05 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Volume be21228c-a653-4e08-ac38-251cdad1889d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be21228c-a653-4e08-ac38-251cdad1889d', 'volume_size': 1} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-781442260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be21228c-a653-4e08-ac38-251cdad1889d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95db0791e6f41d0be0ac732952a39c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:35:05Z,use_quota=True,user_id='0abe94bea82d4527935eeae009a0ff9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Creating volume be21228c-a653-4e08-ac38-251cdad1889d {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:35:05 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:35:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:05 devstack sudo[110864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d 1073741824 Aug 13 09:35:05 devstack sudo[110864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:06 devstack sudo[110864]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d 1073741824" returned: 0 in 0.516s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:06 devstack sudo[110870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d Aug 13 09:35:06 devstack sudo[110870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:06 devstack sudo[110870]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d" returned: 0 in 0.277s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:35:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f512342b-b56b-4d54-b11f-d6dbb73034ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be21228c-a653-4e08-ac38-251cdad1889d', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d6f966-d14d-467c-b7d3-08bb70f376db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:06 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Volume volume-be21228c-a653-4e08-ac38-251cdad1889d (be21228c-a653-4e08-ac38-251cdad1889d): created successfully Aug 13 09:35:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d6f966-d14d-467c-b7d3-08bb70f376db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Flow 'volume_create_manager' (276b22bc-be9c-41c9-8df5-8494931da4bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:35:06 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5f24cd9e-3f90-41ea-bd29-a6ef8108d9eb tempest-TestStampPattern-196712714 None] Created volume successfully. Aug 13 09:35:16 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:35:16 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Flow 'volume_create_manager' (a0722568-1461-4b52-b667-bad881210ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44d2543-c883-4129-bd42-772a209f7611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44d2543-c883-4129-bd42-772a209f7611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1236699099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d96c47-1602-4a33-90e0-7a8af0dad0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391038b658a44acdbbcdee31407a90f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:35:36Z,use_quota=True,user_id='fa9dda6aadca41248a8aeaa3a20e6e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12f3b55-32b9-4859-9d53-44b4bcad35a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12f3b55-32b9-4859-9d53-44b4bcad35a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0866a8ca-fdeb-42cb-b92e-b1b9cf7a7247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0866a8ca-fdeb-42cb-b92e-b1b9cf7a7247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98d96c47-1602-4a33-90e0-7a8af0dad0aa', 'volume_name': 'volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe5723d-f022-4751-b0a2-55bc5d2de677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe5723d-f022-4751-b0a2-55bc5d2de677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f098c077-2425-4ddd-840b-d08f8fcc02de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:36 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Volume 98d96c47-1602-4a33-90e0-7a8af0dad0aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa', 'volume_size': 1} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1236699099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d96c47-1602-4a33-90e0-7a8af0dad0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391038b658a44acdbbcdee31407a90f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:35:36Z,use_quota=True,user_id='fa9dda6aadca41248a8aeaa3a20e6e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Creating volume 98d96c47-1602-4a33-90e0-7a8af0dad0aa {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:35:36 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:36 devstack sudo[111144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa 1073741824 Aug 13 09:35:36 devstack sudo[111144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:36 devstack sudo[111144]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa 1073741824" returned: 0 in 0.477s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:36 devstack sudo[111150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa Aug 13 09:35:36 devstack sudo[111150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:36 devstack sudo[111150]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa" returned: 0 in 0.262s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f098c077-2425-4ddd-840b-d08f8fcc02de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927df1cb-35c7-4488-9cd6-b934793e2a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:36 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Volume volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa (98d96c47-1602-4a33-90e0-7a8af0dad0aa): created successfully Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927df1cb-35c7-4488-9cd6-b934793e2a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:36 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Flow 'volume_create_manager' (a0722568-1461-4b52-b667-bad881210ea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:35:36 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-857401ab-3ec1-44f0-a573-4076b2cc6ad6 tempest-VolumesActionsTest-2077698395 None] Created volume successfully. Aug 13 09:35:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-57c1fb10-837d-4b5e-a446-468de85f0649 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "cinder-98d96c47-1602-4a33-90e0-7a8af0dad0aa" by "attach_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:35:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-57c1fb10-837d-4b5e-a446-468de85f0649 tempest-VolumesActionsTest-2077698395 None] Lock "cinder-98d96c47-1602-4a33-90e0-7a8af0dad0aa" acquired by "attach_volume" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:35:38 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-57c1fb10-837d-4b5e-a446-468de85f0649 tempest-VolumesActionsTest-2077698395 None] Attaching volume 98d96c47-1602-4a33-90e0-7a8af0dad0aa to instance 4439a2b0-4899-45a5-a336-8926bc1381e7 at mountpoint /dev/vdb on host None. Aug 13 09:35:38 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-57c1fb10-837d-4b5e-a446-468de85f0649 tempest-VolumesActionsTest-2077698395 None] Attach volume completed successfully. Aug 13 09:35:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-a8c1f542-d3a3-44c6-8ddf-80814d5d331e req-23855156-cd9d-4749-b699-a1356e24da35 tempest-TestStampPattern-196712714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-a8c1f542-d3a3-44c6-8ddf-80814d5d331e req-23855156-cd9d-4749-b699-a1356e24da35 tempest-TestStampPattern-196712714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-57c1fb10-837d-4b5e-a446-468de85f0649 tempest-VolumesActionsTest-2077698395 None] Lock "cinder-98d96c47-1602-4a33-90e0-7a8af0dad0aa" released by "attach_volume" :: held 0.178s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:35:38 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cd186c-4b5e-4800-8d1b-1997e1d63b7c]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:35:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-a8c1f542-d3a3-44c6-8ddf-80814d5d331e req-23855156-cd9d-4749-b699-a1356e24da35 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:38 devstack sudo[111174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d Aug 13 09:35:38 devstack sudo[111174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:38 devstack sudo[111174]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-a8c1f542-d3a3-44c6-8ddf-80814d5d331e req-23855156-cd9d-4749-b699-a1356e24da35 tempest-TestStampPattern-196712714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d" returned: 0 in 0.422s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-a8c1f542-d3a3-44c6-8ddf-80814d5d331e req-23855156-cd9d-4749-b699-a1356e24da35 tempest-TestStampPattern-196712714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.449s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-a8c1f542-d3a3-44c6-8ddf-80814d5d331e req-23855156-cd9d-4749-b699-a1356e24da35 tempest-TestStampPattern-196712714 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-be21228c-a653-4e08-ac38-251cdad1889d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ec3cb09-3f74-4cd2-b726-4a7f6b231266', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:35:38 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-2bf08dcc-527c-468d-a9a1-efe5f6f651eb tempest-VolumesActionsTest-763581266 None] Terminate volume connection completed successfully. Aug 13 09:35:38 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-a8c1f542-d3a3-44c6-8ddf-80814d5d331e req-23855156-cd9d-4749-b699-a1356e24da35 tempest-TestStampPattern-196712714 None] attachment_update completed successfully. Aug 13 09:35:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2bf08dcc-527c-468d-a9a1-efe5f6f651eb tempest-VolumesActionsTest-763581266 None] Acquiring lock "cinder-98d96c47-1602-4a33-90e0-7a8af0dad0aa-detach_volume" by "detach_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:35:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2bf08dcc-527c-468d-a9a1-efe5f6f651eb tempest-VolumesActionsTest-763581266 None] Lock "cinder-98d96c47-1602-4a33-90e0-7a8af0dad0aa-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:35:38 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-2bf08dcc-527c-468d-a9a1-efe5f6f651eb tempest-VolumesActionsTest-763581266 None] Detaching volume 98d96c47-1602-4a33-90e0-7a8af0dad0aa from instance 4439a2b0-4899-45a5-a336-8926bc1381e7. Aug 13 09:35:38 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-2bf08dcc-527c-468d-a9a1-efe5f6f651eb tempest-VolumesActionsTest-763581266 None] Detach volume completed successfully. Aug 13 09:35:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2bf08dcc-527c-468d-a9a1-efe5f6f651eb tempest-VolumesActionsTest-763581266 None] Lock "cinder-98d96c47-1602-4a33-90e0-7a8af0dad0aa-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:35:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4daeea39-fdb0-4017-9d5a-1f8ea2782a89 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "cinder-98d96c47-1602-4a33-90e0-7a8af0dad0aa-detach_volume" by "detach_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:35:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4daeea39-fdb0-4017-9d5a-1f8ea2782a89 tempest-VolumesActionsTest-2077698395 None] Lock "cinder-98d96c47-1602-4a33-90e0-7a8af0dad0aa-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:35:39 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-4daeea39-fdb0-4017-9d5a-1f8ea2782a89 tempest-VolumesActionsTest-2077698395 None] Volume detach called, but volume not attached. Aug 13 09:35:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4daeea39-fdb0-4017-9d5a-1f8ea2782a89 tempest-VolumesActionsTest-2077698395 None] Lock "cinder-98d96c47-1602-4a33-90e0-7a8af0dad0aa-detach_volume" released by "detach_volume" :: held 0.018s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:35:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "cinder-98d96c47-1602-4a33-90e0-7a8af0dad0aa-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:35:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Lock "cinder-98d96c47-1602-4a33-90e0-7a8af0dad0aa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:35:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "cinder-quobyte-98d96c47-1602-4a33-90e0-7a8af0dad0aa" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:35:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Lock "cinder-quobyte-98d96c47-1602-4a33-90e0-7a8af0dad0aa" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:35:39 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a490afa9-c4c1-4c72-ad9a-1c526263ee34]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:35:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:39 devstack sudo[111565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa Aug 13 09:35:39 devstack sudo[111565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:40 devstack sudo[111565]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa" returned: 0 in 0.405s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:40 devstack sudo[111571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa Aug 13 09:35:40 devstack sudo[111571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:40 devstack sudo[111571]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-98d96c47-1602-4a33-90e0-7a8af0dad0aa" returned: 0 in 0.257s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Lock "cinder-quobyte-98d96c47-1602-4a33-90e0-7a8af0dad0aa" released by "delete_volume" :: held 0.713s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:35:40 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Created reservations ['213f557c-97fc-4913-8889-8958123dc780', 'f41d742e-94b5-40f0-88f6-2114b4f2959f', 'df74c437-1354-49c4-9850-a4708b91b0ea', '7cb035e3-bdb5-454c-a188-8b87e09bb2a3'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:35:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:35:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:35:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:40 devstack sudo[111578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:35:40 devstack sudo[111578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:40 devstack sudo[111578]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.277s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:40 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:35:40 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Deleted volume successfully. Aug 13 09:35:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-14fac696-afef-40ad-817c-4d7741996648 tempest-VolumesActionsTest-2077698395 None] Lock "cinder-98d96c47-1602-4a33-90e0-7a8af0dad0aa-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:35:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:35:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:35:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:35:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:43 devstack sudo[111619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:35:43 devstack sudo[111619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:43 devstack sudo[111619]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.286s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:35:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:35:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:35:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Flow 'volume_create_manager' (4ff7b3b4-9721-4357-be59-cbf981ad974c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a0d139-7ef3-42a7-80ac-51a0ba907b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a0d139-7ef3-42a7-80ac-51a0ba907b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-216974878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1be2fb-2fcc-4999-96c5-8994472dc9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391038b658a44acdbbcdee31407a90f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:35:44Z,use_quota=True,user_id='fa9dda6aadca41248a8aeaa3a20e6e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7089332-c741-4ba1-806c-7edd04514f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7089332-c741-4ba1-806c-7edd04514f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6516c4c4-8d20-479a-bfbf-6f05bd158f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6516c4c4-8d20-479a-bfbf-6f05bd158f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d1be2fb-2fcc-4999-96c5-8994472dc9eb', 'volume_name': 'volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29748d6e-18b8-434b-a4ce-0dd8c90a624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29748d6e-18b8-434b-a4ce-0dd8c90a624c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799d89d6-b03d-49b6-8d90-1343dffae42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:44 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Volume 8d1be2fb-2fcc-4999-96c5-8994472dc9eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb', 'volume_size': 1} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-216974878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1be2fb-2fcc-4999-96c5-8994472dc9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391038b658a44acdbbcdee31407a90f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:35:44Z,use_quota=True,user_id='fa9dda6aadca41248a8aeaa3a20e6e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Creating volume 8d1be2fb-2fcc-4999-96c5-8994472dc9eb {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:35:44 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:44 devstack sudo[111629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb 1073741824 Aug 13 09:35:44 devstack sudo[111629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:44 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-ffb73baf-2f38-492f-a9ae-e95aea7461e4 req-54f9eac8-c4ab-4b9d-bb77-88af1c1bece6 tempest-TestStampPattern-196712714 None] Terminate volume connection completed successfully. Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-ffb73baf-2f38-492f-a9ae-e95aea7461e4 req-54f9eac8-c4ab-4b9d-bb77-88af1c1bece6 tempest-TestStampPattern-196712714 None] Deleting attachment 8ec3cb09-3f74-4cd2-b726-4a7f6b231266. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:35:44 devstack sudo[111629]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb 1073741824" returned: 0 in 0.556s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:44 devstack sudo[111661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb Aug 13 09:35:44 devstack sudo[111661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:45 devstack sudo[111661]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb" returned: 0 in 0.287s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:35:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799d89d6-b03d-49b6-8d90-1343dffae42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b16d4b-3c2b-4e4c-8fe5-53dda85a4b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:45 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Volume volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb (8d1be2fb-2fcc-4999-96c5-8994472dc9eb): created successfully Aug 13 09:35:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b16d4b-3c2b-4e4c-8fe5-53dda85a4b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:45 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Flow 'volume_create_manager' (4ff7b3b4-9721-4357-be59-cbf981ad974c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:35:45 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-49a208b6-bf01-4944-b682-7fbd3c0646ad tempest-VolumesActionsTest-2077698395 None] Created volume successfully. Aug 13 09:35:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] Creating offline snapshot 17f0c4a1-8778-4993-9f4b-374cbaed7974 of volume be21228c-a653-4e08-ac38-251cdad1889d {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:35:45 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7092c3-e2da-4609-872d-ead0d5093606]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:35:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:45 devstack sudo[111664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d Aug 13 09:35:45 devstack sudo[111664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:45 devstack sudo[111664]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d" returned: 0 in 0.372s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:45 devstack sudo[111670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 1G Aug 13 09:35:45 devstack sudo[111670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:46 devstack sudo[111670]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 1G" returned: 0 in 0.375s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be21228c-a653-4e08-ac38-251cdad1889d -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:46 devstack sudo[111675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be21228c-a653-4e08-ac38-251cdad1889d -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 Aug 13 09:35:46 devstack sudo[111675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:46 devstack sudo[111675]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be21228c-a653-4e08-ac38-251cdad1889d -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974" returned: 0 in 0.317s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:46 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 is being set with open permissions: ugo+rw Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:46 devstack sudo[111681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 Aug 13 09:35:46 devstack sudo[111681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Acquiring lock "cinder-8d1be2fb-2fcc-4999-96c5-8994472dc9eb-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Lock "cinder-8d1be2fb-2fcc-4999-96c5-8994472dc9eb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Acquiring lock "cinder-quobyte-8d1be2fb-2fcc-4999-96c5-8994472dc9eb" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Lock "cinder-quobyte-8d1be2fb-2fcc-4999-96c5-8994472dc9eb" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9d0fb1-db18-4487-add8-166e4e0577be]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:46 devstack sudo[111681]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974" returned: 0 in 0.268s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:46 devstack sudo[111683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb Aug 13 09:35:46 devstack sudo[111683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:46 devstack sudo[111686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.info Aug 13 09:35:46 devstack sudo[111686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:46 devstack sudo[111686]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.info" returned: 0 in 0.258s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:46 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.info is being set with open permissions: ugo+rw Aug 13 09:35:46 devstack sudo[111683]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb" returned: 0 in 0.390s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:46 devstack sudo[111693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.info Aug 13 09:35:46 devstack sudo[111693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:46 devstack sudo[111694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb Aug 13 09:35:46 devstack sudo[111694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:47 devstack sudo[111694]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:47 devstack sudo[111693]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8d1be2fb-2fcc-4999-96c5-8994472dc9eb" returned: 0 in 0.246s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.info" returned: 0 in 0.267s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Lock "cinder-quobyte-8d1be2fb-2fcc-4999-96c5-8994472dc9eb" released by "delete_volume" :: held 0.707s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:35:47 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d159bc48-d1bf-44ab-a9a6-b730dd872a52 tempest-TestStampPattern-196712714 None] Create snapshot completed successfully Aug 13 09:35:47 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Created reservations ['b0f547cf-a97a-4b8b-9522-37aed7d99f41', '03926ef2-d61d-43b2-883e-ac27f1917984', '1da95e2a-ef43-466a-9994-845e1c7f94e5', '96dabe19-4558-4a77-ab41-d0cacf80b302'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:35:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:35:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:35:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:47 devstack sudo[111699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:35:47 devstack sudo[111699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:47 devstack sudo[111699]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.289s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:47 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:35:47 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Deleted volume successfully. Aug 13 09:35:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a169f493-4f18-41bb-9570-b4ef9835ee10 tempest-VolumesActionsTest-763581266 None] Lock "cinder-8d1be2fb-2fcc-4999-96c5-8994472dc9eb-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Flow 'volume_create_manager' (a1ef8246-5f4d-4312-8d2c-b4ab31836201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257fd07e-9b3d-4e5c-b5ae-f05467b6aeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257fd07e-9b3d-4e5c-b5ae-f05467b6aeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1470092293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa402c5e-c96d-40f4-838d-55c3c6dd2565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391038b658a44acdbbcdee31407a90f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:35:48Z,use_quota=True,user_id='fa9dda6aadca41248a8aeaa3a20e6e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b8f463-3b04-4443-9403-8f7bbd11a80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b8f463-3b04-4443-9403-8f7bbd11a80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c99982-92e3-4110-8752-90405c43ca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c99982-92e3-4110-8752-90405c43ca9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa402c5e-c96d-40f4-838d-55c3c6dd2565', 'volume_name': 'volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7f2c04-864d-428a-86b4-b90b94762d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7f2c04-864d-428a-86b4-b90b94762d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4d2efb-8f1c-498b-ba64-06ca79dfbc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:48 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Volume aa402c5e-c96d-40f4-838d-55c3c6dd2565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565', 'volume_size': 1} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1470092293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa402c5e-c96d-40f4-838d-55c3c6dd2565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391038b658a44acdbbcdee31407a90f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:35:48Z,use_quota=True,user_id='fa9dda6aadca41248a8aeaa3a20e6e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Creating volume aa402c5e-c96d-40f4-838d-55c3c6dd2565 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:35:48 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:48 devstack sudo[111702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565 1073741824 Aug 13 09:35:48 devstack sudo[111702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:48 devstack sudo[111702]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565 1073741824" returned: 0 in 0.506s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:48 devstack sudo[111708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565 Aug 13 09:35:48 devstack sudo[111708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:48 devstack sudo[111708]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565" returned: 0 in 0.246s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:35:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4d2efb-8f1c-498b-ba64-06ca79dfbc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2f2336-a582-474d-aad6-5d478c1d2b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:49 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Volume volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565 (aa402c5e-c96d-40f4-838d-55c3c6dd2565): created successfully Aug 13 09:35:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2f2336-a582-474d-aad6-5d478c1d2b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:49 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Flow 'volume_create_manager' (a1ef8246-5f4d-4312-8d2c-b4ab31836201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:35:49 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3c66aa8f-b2cb-4c4b-b2d9-f8fd85210455 tempest-VolumesActionsTest-2077698395 None] Created volume successfully. Aug 13 09:35:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Acquiring lock "cinder-aa402c5e-c96d-40f4-838d-55c3c6dd2565-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:35:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Lock "cinder-aa402c5e-c96d-40f4-838d-55c3c6dd2565-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:35:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Acquiring lock "cinder-quobyte-aa402c5e-c96d-40f4-838d-55c3c6dd2565" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:35:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Lock "cinder-quobyte-aa402c5e-c96d-40f4-838d-55c3c6dd2565" acquired by "delete_volume" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:35:49 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a1163b-2083-4665-a7fc-cae2eb5f818b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:35:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:49 devstack sudo[111727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565 Aug 13 09:35:49 devstack sudo[111727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:49 devstack sudo[111727]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565" returned: 0 in 0.408s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:49 devstack sudo[111739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565 Aug 13 09:35:49 devstack sudo[111739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:50 devstack sudo[111739]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-aa402c5e-c96d-40f4-838d-55c3c6dd2565" returned: 0 in 0.281s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Lock "cinder-quobyte-aa402c5e-c96d-40f4-838d-55c3c6dd2565" released by "delete_volume" :: held 0.735s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:35:50 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Created reservations ['a7b88b86-e95a-4002-8b9d-64349206fd4d', '8eb87f89-5817-4201-aa32-2e67d4501dc7', '00e588cd-85c2-40b3-a795-0f7313e27215', '5afcd14b-c2c4-4a12-ac30-d0f2754afefd'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:35:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:35:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:35:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:50 devstack sudo[111743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:35:50 devstack sudo[111743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:50 devstack sudo[111743]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.309s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:50 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:35:50 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Deleted volume successfully. Aug 13 09:35:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-fd47e948-7aaa-4153-8cc6-0fafba1e5e6c tempest-VolumesActionsTest-763581266 None] Lock "cinder-aa402c5e-c96d-40f4-838d-55c3c6dd2565-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Flow 'volume_create_manager' (f1f1dfed-d7fe-4e00-a8b9-5d0d5216ea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98bb978a-d18f-4aac-800e-e9e0ca0acc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98bb978a-d18f-4aac-800e-e9e0ca0acc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2063798843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216bd91f-5e1b-4dd1-a531-cb5d461e4464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391038b658a44acdbbcdee31407a90f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:35:51Z,use_quota=True,user_id='fa9dda6aadca41248a8aeaa3a20e6e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9604da4b-0037-4faf-85e5-6fc15c61f9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9604da4b-0037-4faf-85e5-6fc15c61f9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e30afa7-2eff-42fb-bbc8-82cea72718f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e30afa7-2eff-42fb-bbc8-82cea72718f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '216bd91f-5e1b-4dd1-a531-cb5d461e4464', 'volume_name': 'volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5efb7d8-575b-4b29-9ba7-a651e1a89cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5efb7d8-575b-4b29-9ba7-a651e1a89cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67851434-faeb-4a41-af3a-581a334d71a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:51 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Volume 216bd91f-5e1b-4dd1-a531-cb5d461e4464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464', 'volume_size': 1} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2063798843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216bd91f-5e1b-4dd1-a531-cb5d461e4464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391038b658a44acdbbcdee31407a90f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:35:51Z,use_quota=True,user_id='fa9dda6aadca41248a8aeaa3a20e6e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Creating volume 216bd91f-5e1b-4dd1-a531-cb5d461e4464 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:35:51 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:51 devstack sudo[111756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464 1073741824 Aug 13 09:35:51 devstack sudo[111756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:51 devstack sudo[111756]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464 1073741824" returned: 0 in 0.596s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:51 devstack sudo[111768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464 Aug 13 09:35:51 devstack sudo[111768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:52 devstack sudo[111768]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464" returned: 0 in 0.290s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:35:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67851434-faeb-4a41-af3a-581a334d71a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc67d54d-1e7f-450c-b490-18214787be40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:52 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Volume volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464 (216bd91f-5e1b-4dd1-a531-cb5d461e4464): created successfully Aug 13 09:35:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc67d54d-1e7f-450c-b490-18214787be40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Flow 'volume_create_manager' (f1f1dfed-d7fe-4e00-a8b9-5d0d5216ea4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:35:52 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-dd1f3e61-0898-4574-bc8b-cd63806332d6 tempest-VolumesActionsTest-2077698395 None] Created volume successfully. Aug 13 09:35:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Acquiring lock "cinder-216bd91f-5e1b-4dd1-a531-cb5d461e4464-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:35:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Lock "cinder-216bd91f-5e1b-4dd1-a531-cb5d461e4464-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:35:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Acquiring lock "cinder-quobyte-216bd91f-5e1b-4dd1-a531-cb5d461e4464" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:35:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Lock "cinder-quobyte-216bd91f-5e1b-4dd1-a531-cb5d461e4464" acquired by "delete_volume" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:35:53 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafe6b69-5b37-48e1-b40e-4c4040bcbcc5]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:35:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:53 devstack sudo[111771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464 Aug 13 09:35:53 devstack sudo[111771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:53 devstack sudo[111771]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464" returned: 0 in 0.385s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:53 devstack sudo[111777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464 Aug 13 09:35:53 devstack sudo[111777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:54 devstack sudo[111777]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-216bd91f-5e1b-4dd1-a531-cb5d461e4464" returned: 0 in 0.279s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Lock "cinder-quobyte-216bd91f-5e1b-4dd1-a531-cb5d461e4464" released by "delete_volume" :: held 0.712s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:35:54 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Created reservations ['9794c3e9-3ba3-410e-8c0a-a331fbb87d82', 'dd11c369-987e-4993-b996-c2788824761b', '464c712d-9605-4808-b79a-48a2f9e88f46', 'e319c8fa-9c59-4b0f-a121-ef3d0fb0086c'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:35:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:35:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:35:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:54 devstack sudo[111780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:35:54 devstack sudo[111780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:54 devstack sudo[111780]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.251s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:54 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:35:54 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Deleted volume successfully. Aug 13 09:35:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-02e2b157-3670-4d64-b34c-7c481ccff2ea tempest-VolumesActionsTest-763581266 None] Lock "cinder-216bd91f-5e1b-4dd1-a531-cb5d461e4464-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Flow 'volume_create_manager' (9026b54c-3d80-4773-ae4a-e057cf0d0f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2051eae6-f63e-423b-bbbd-020e26d486f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2051eae6-f63e-423b-bbbd-020e26d486f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-833868526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39fad9e-282a-4375-acd2-9f8fa4524c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391038b658a44acdbbcdee31407a90f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:35:55Z,use_quota=True,user_id='fa9dda6aadca41248a8aeaa3a20e6e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9140e1b-5e8e-4325-999f-c463f0c01be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9140e1b-5e8e-4325-999f-c463f0c01be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d479ae-3c5c-4d2e-a6c9-ddef2bcbe943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d479ae-3c5c-4d2e-a6c9-ddef2bcbe943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b39fad9e-282a-4375-acd2-9f8fa4524c35', 'volume_name': 'volume-b39fad9e-282a-4375-acd2-9f8fa4524c35', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2091dcbe-6d8a-42b9-b089-5cf2f0d3df85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2091dcbe-6d8a-42b9-b089-5cf2f0d3df85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4feb6c-5898-4f9c-b222-0859ccfeeb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:55 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Volume b39fad9e-282a-4375-acd2-9f8fa4524c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b39fad9e-282a-4375-acd2-9f8fa4524c35', 'volume_size': 1} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-833868526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39fad9e-282a-4375-acd2-9f8fa4524c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391038b658a44acdbbcdee31407a90f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:35:55Z,use_quota=True,user_id='fa9dda6aadca41248a8aeaa3a20e6e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Creating volume b39fad9e-282a-4375-acd2-9f8fa4524c35 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:35:55 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b39fad9e-282a-4375-acd2-9f8fa4524c35 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:55 devstack sudo[111783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b39fad9e-282a-4375-acd2-9f8fa4524c35 1073741824 Aug 13 09:35:55 devstack sudo[111783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Flow 'volume_create_manager' (b47efd4e-f1f7-4a12-95eb-f49346371ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69344507-6679-4f1d-b9a7-b3857e26f0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69344507-6679-4f1d-b9a7-b3857e26f0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-907729132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95db0791e6f41d0be0ac732952a39c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=17f0c4a1-8778-4993-9f4b-374cbaed7974,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:35:55Z,use_quota=True,user_id='0abe94bea82d4527935eeae009a0ff9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceff0137-8523-4fbf-9b43-3beb04595945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceff0137-8523-4fbf-9b43-3beb04595945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b30cf4-676e-4a17-bc88-d7c6afbe7ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b30cf4-676e-4a17-bc88-d7c6afbe7ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d', 'volume_name': 'volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d', 'volume_size': 1, 'snapshot_id': '17f0c4a1-8778-4993-9f4b-374cbaed7974'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3952bf51-cc8c-49c0-a904-d128d8cacd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3952bf51-cc8c-49c0-a904-d128d8cacd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e50b2ff-572e-4972-ad9c-8253953d8c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:55 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Volume e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d', 'volume_size': 1, 'snapshot_id': '17f0c4a1-8778-4993-9f4b-374cbaed7974'} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:55 devstack sudo[111783]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b39fad9e-282a-4375-acd2-9f8fa4524c35 1073741824" returned: 0 in 0.541s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b39fad9e-282a-4375-acd2-9f8fa4524c35 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:55 devstack sudo[111789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b39fad9e-282a-4375-acd2-9f8fa4524c35 Aug 13 09:35:55 devstack sudo[111789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:56 devstack sudo[111789]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b39fad9e-282a-4375-acd2-9f8fa4524c35" returned: 0 in 0.305s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.537s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Acquiring lock "cinder-quobyte-17f0c4a1-8778-4993-9f4b-374cbaed7974-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d" by "_create_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4feb6c-5898-4f9c-b222-0859ccfeeb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b39fad9e-282a-4375-acd2-9f8fa4524c35', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb3e4b9-a467-4615-aadb-a01ec7cee917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Lock "cinder-quobyte-17f0c4a1-8778-4993-9f4b-374cbaed7974-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Creating volume e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d from snapshot 17f0c4a1-8778-4993-9f4b-374cbaed7974 {{(pid=94670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Acquiring lock "cinder-quobyte-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d" by "_copy_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:35:56 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Volume volume-b39fad9e-282a-4375-acd2-9f8fa4524c35 (b39fad9e-282a-4375-acd2-9f8fa4524c35): created successfully Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb3e4b9-a467-4615-aadb-a01ec7cee917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Flow 'volume_create_manager' (9026b54c-3d80-4773-ae4a-e057cf0d0f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Lock "cinder-quobyte-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] snapshot: 17f0c4a1-8778-4993-9f4b-374cbaed7974, volume: e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d, {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 13 09:35:56 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-163c9d9a-a487-4ef6-a611-cfb1169d654b tempest-VolumesActionsTest-2077698395 None] Created volume successfully. Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[744117a3-9bfe-4b05-a613-16b8d5a19f0d]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:56 devstack sudo[111795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 Aug 13 09:35:56 devstack sudo[111795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:56 devstack sudo[111795]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974" returned: 0 in 0.418s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be21228c-a653-4e08-ac38-251cdad1889d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Creating direct copy from snapshot {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[53de6d62-a603-4a1f-b68e-21d9708682c6]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:35:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:56 devstack sudo[111800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d Aug 13 09:35:56 devstack sudo[111800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:57 devstack sudo[111800]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d" returned: 0 in 0.395s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:57 devstack cinder-volume[94670]: DEBUG cinder.utils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Path /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d not found in is_blk_device check {{(pid=94670) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 13 09:35:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:57 devstack sudo[111805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d Aug 13 09:35:57 devstack sudo[111805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Acquiring lock "cinder-b39fad9e-282a-4375-acd2-9f8fa4524c35-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:35:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Lock "cinder-b39fad9e-282a-4375-acd2-9f8fa4524c35-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:35:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Acquiring lock "cinder-quobyte-b39fad9e-282a-4375-acd2-9f8fa4524c35" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:35:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Lock "cinder-quobyte-b39fad9e-282a-4375-acd2-9f8fa4524c35" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:35:57 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5daf62-4c75-44cf-9875-c990fc3c76ad]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:35:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b39fad9e-282a-4375-acd2-9f8fa4524c35 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:57 devstack sudo[111810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b39fad9e-282a-4375-acd2-9f8fa4524c35 Aug 13 09:35:57 devstack sudo[111810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:58 devstack sudo[111810]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b39fad9e-282a-4375-acd2-9f8fa4524c35" returned: 0 in 1.067s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b39fad9e-282a-4375-acd2-9f8fa4524c35 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:35:58 devstack sudo[111824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b39fad9e-282a-4375-acd2-9f8fa4524c35 Aug 13 09:35:58 devstack sudo[111824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:35:59 devstack sudo[111824]: pam_unix(sudo:session): session closed for user root Aug 13 09:35:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b39fad9e-282a-4375-acd2-9f8fa4524c35" returned: 0 in 0.720s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:35:59 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Lock "cinder-quobyte-b39fad9e-282a-4375-acd2-9f8fa4524c35" released by "delete_volume" :: held 1.888s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:35:59 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Created reservations ['a9f3c204-ec38-40e6-8d13-988951d395bc', 'a82effb5-805d-4363-8bf2-081e00668b90', '4e109cda-bfc0-4f7a-8b75-02baac7627c6', '07d66a8e-75f6-4017-adcb-e2c5c0fe6c68'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:35:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:35:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:35:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:35:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:35:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:35:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:00 devstack sudo[111828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:36:00 devstack sudo[111828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:00 devstack sudo[111828]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.800s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:00 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:36:00 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Deleted volume successfully. Aug 13 09:36:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f3ca6e9f-0e4e-43a3-983c-638c2a9dd8fd tempest-VolumesActionsTest-763581266 None] Lock "cinder-b39fad9e-282a-4375-acd2-9f8fa4524c35-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:01 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:36:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Flow 'volume_create_manager' (6084132a-6ffa-4c8f-80f7-f4f270aa7fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:36:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ea14ca-1642-48f6-a1fe-97f23cae919a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ea14ca-1642-48f6-a1fe-97f23cae919a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-815854644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecc3b74-c4a6-49c4-ad15-87d6734ee10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391038b658a44acdbbcdee31407a90f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:36:02Z,use_quota=True,user_id='fa9dda6aadca41248a8aeaa3a20e6e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57534744-7306-4e9f-876e-575650a1670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57534744-7306-4e9f-876e-575650a1670e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8c03ca-ee5b-4f69-933b-16481c16b3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8c03ca-ee5b-4f69-933b-16481c16b3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ecc3b74-c4a6-49c4-ad15-87d6734ee10c', 'volume_name': 'volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1720aaca-be18-4d4b-9158-cfe8d57b2cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1720aaca-be18-4d4b-9158-cfe8d57b2cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5812c4c3-ebe3-482e-ae3f-3bfcc94db2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:02 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Volume 9ecc3b74-c4a6-49c4-ad15-87d6734ee10c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c', 'volume_size': 1} Aug 13 09:36:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:03 devstack sudo[111805]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d" returned: 0 in 6.343s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:03 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[54195ca1-8ea1-460d-b33a-05c475722992]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:36:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:03 devstack sudo[111852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d Aug 13 09:36:03 devstack sudo[111852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:04 devstack sudo[111852]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d" returned: 0 in 0.622s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Image conversion details: src /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:36:04 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Converted 1024.00 MB image at 161.41 MB/s Aug 13 09:36:04 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d is being set with open permissions: ugo+rw Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:04 devstack sudo[111867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d Aug 13 09:36:04 devstack sudo[111867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:04 devstack sudo[111867]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d" returned: 0 in 0.453s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Lock "cinder-quobyte-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d" released by "_copy_volume_from_snapshot" :: held 8.364s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Lock "cinder-quobyte-17f0c4a1-8778-4993-9f4b-374cbaed7974-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d" released by "_create_volume_from_snapshot" :: held 8.408s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.456s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.510s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-815854644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecc3b74-c4a6-49c4-ad15-87d6734ee10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391038b658a44acdbbcdee31407a90f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:36:02Z,use_quota=True,user_id='fa9dda6aadca41248a8aeaa3a20e6e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Creating volume 9ecc3b74-c4a6-49c4-ad15-87d6734ee10c {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:36:04 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:04 devstack sudo[111888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c 1073741824 Aug 13 09:36:04 devstack sudo[111888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e50b2ff-572e-4972-ad9c-8253953d8c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d', 'volume_size': 1, 'snapshot_id': '17f0c4a1-8778-4993-9f4b-374cbaed7974'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c156744b-bd88-445e-9af4-b289bc039835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:04 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Volume volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d (e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d): created successfully Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c156744b-bd88-445e-9af4-b289bc039835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Flow 'volume_create_manager' (b47efd4e-f1f7-4a12-95eb-f49346371ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:36:04 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b97220f5-e0fe-4cff-952e-4ce7d54a5a14 tempest-TestStampPattern-196712714 None] Created volume successfully. Aug 13 09:36:05 devstack sudo[111888]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c 1073741824" returned: 0 in 0.723s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:05 devstack sudo[111917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c Aug 13 09:36:05 devstack sudo[111917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:05 devstack sudo[111917]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c" returned: 0 in 0.285s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:36:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5812c4c3-ebe3-482e-ae3f-3bfcc94db2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1da1a83-d8b3-4d6b-a6c9-bc17cbce5968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:05 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Volume volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c (9ecc3b74-c4a6-49c4-ad15-87d6734ee10c): created successfully Aug 13 09:36:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1da1a83-d8b3-4d6b-a6c9-bc17cbce5968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Flow 'volume_create_manager' (6084132a-6ffa-4c8f-80f7-f4f270aa7fef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:36:05 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-45ad4a86-5cc2-4d1b-8f47-eee0a3b83bc5 tempest-VolumesActionsTest-2077698395 None] Created volume successfully. Aug 13 09:36:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "cinder-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Lock "cinder-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "cinder-quobyte-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Lock "cinder-quobyte-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c" acquired by "delete_volume" :: waited 0.023s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:06 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b07b8d6-9e64-4482-9945-80f81fb68d0d]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:36:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:07 devstack sudo[111936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c Aug 13 09:36:07 devstack sudo[111936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:07 devstack sudo[111936]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c" returned: 0 in 0.394s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:07 devstack sudo[111941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c Aug 13 09:36:07 devstack sudo[111941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:07 devstack sudo[111941]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c" returned: 0 in 0.302s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Lock "cinder-quobyte-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c" released by "delete_volume" :: held 0.753s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:07 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Created reservations ['3ef00c1d-199e-41b0-a662-cfdb3519483f', 'e1cb50f8-c01d-49d0-8728-6ec66edc6f60', '018d2af1-79c4-4e07-9bb6-80588abcd7e4', '9c0b3c55-3271-466b-b567-cbe4930d35ed'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:36:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:36:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:36:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:07 devstack sudo[111944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:36:07 devstack sudo[111944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:08 devstack sudo[111944]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.305s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:08 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:36:08 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Deleted volume successfully. Aug 13 09:36:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bc0d8809-a1c1-4252-997a-2dc502b04935 tempest-VolumesActionsTest-2077698395 None] Lock "cinder-9ecc3b74-c4a6-49c4-ad15-87d6734ee10c-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:17 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=68,cinder:INSERT=18,cinder:UPDATE=77,cinder:DELETE=7 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:36:18 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=72,cinder:DELETE=7,cinder:SELECT=56,cinder:INSERT=15 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Flow 'volume_create_manager' (d1be5754-5c32-436e-a033-561f3aad81c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5ebe6e-3b9d-4754-bea6-db8bd10ecd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5ebe6e-3b9d-4754-bea6-db8bd10ecd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-826733928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e855f452-3c7c-424a-80ab-6fc834b5222e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e9853c92d9144a38f96b8ecbcf2b569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:36:21Z,use_quota=True,user_id='a83c12bd44fd482599a01f9b4acc6b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cd63a6-6f50-4986-8a86-35cd59e3b5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cd63a6-6f50-4986-8a86-35cd59e3b5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe9ec2d-e57d-4797-acfb-9720d993976d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe9ec2d-e57d-4797-acfb-9720d993976d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e855f452-3c7c-424a-80ab-6fc834b5222e', 'volume_name': 'volume-e855f452-3c7c-424a-80ab-6fc834b5222e', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ff621f-489a-44ef-8c42-307bbadbc621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ff621f-489a-44ef-8c42-307bbadbc621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a202cf0e-2edd-4ae8-949f-90e970b170d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:21 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Volume e855f452-3c7c-424a-80ab-6fc834b5222e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e855f452-3c7c-424a-80ab-6fc834b5222e', 'volume_size': 1} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-826733928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e855f452-3c7c-424a-80ab-6fc834b5222e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e9853c92d9144a38f96b8ecbcf2b569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:36:21Z,use_quota=True,user_id='a83c12bd44fd482599a01f9b4acc6b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Creating volume e855f452-3c7c-424a-80ab-6fc834b5222e {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:36:21 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:21 devstack sudo[111966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e 1073741824 Aug 13 09:36:21 devstack sudo[111966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:21 devstack sudo[111966]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e 1073741824" returned: 0 in 0.436s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:21 devstack sudo[111972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e Aug 13 09:36:21 devstack sudo[111972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:21 devstack sudo[111972]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e" returned: 0 in 0.271s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a202cf0e-2edd-4ae8-949f-90e970b170d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e855f452-3c7c-424a-80ab-6fc834b5222e', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9a1fc6-0c7d-44ea-b3a2-0fa3e8864f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:21 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Volume volume-e855f452-3c7c-424a-80ab-6fc834b5222e (e855f452-3c7c-424a-80ab-6fc834b5222e): created successfully Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9a1fc6-0c7d-44ea-b3a2-0fa3e8864f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Flow 'volume_create_manager' (d1be5754-5c32-436e-a033-561f3aad81c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:36:22 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-288c2955-cf04-405f-822b-54fd312f389d tempest-SnapshotMetadataTestJSON-1592729616 None] Created volume successfully. Aug 13 09:36:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] Creating offline snapshot b91c7ea1-3014-446d-a47e-d9306bd14ca3 of volume e855f452-3c7c-424a-80ab-6fc834b5222e {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:36:22 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[120559e9-adbe-4b39-8a75-435be3d1e099]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:36:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:22 devstack sudo[111975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e Aug 13 09:36:22 devstack sudo[111975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:22 devstack sudo[111975]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e" returned: 0 in 0.374s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:22 devstack sudo[111980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3 1G Aug 13 09:36:22 devstack sudo[111980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:23 devstack sudo[111980]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3 1G" returned: 0 in 0.399s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e855f452-3c7c-424a-80ab-6fc834b5222e -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:23 devstack sudo[111987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e855f452-3c7c-424a-80ab-6fc834b5222e -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3 Aug 13 09:36:23 devstack sudo[111987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:23 devstack sudo[111987]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e855f452-3c7c-424a-80ab-6fc834b5222e -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3" returned: 0 in 0.283s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:23 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3 is being set with open permissions: ugo+rw Aug 13 09:36:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:23 devstack sudo[111992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3 Aug 13 09:36:23 devstack sudo[111992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:23 devstack sudo[111992]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3" returned: 0 in 0.255s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:23 devstack sudo[111995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.info Aug 13 09:36:23 devstack sudo[111995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:23 devstack sudo[111995]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.info" returned: 0 in 0.244s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:23 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.info is being set with open permissions: ugo+rw Aug 13 09:36:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:23 devstack sudo[111998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.info Aug 13 09:36:23 devstack sudo[111998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:24 devstack sudo[111998]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.info" returned: 0 in 0.236s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:24 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-a4cfe6a2-d52b-4918-85a1-1970b033309d tempest-SnapshotMetadataTestJSON-1592729616 None] Create snapshot completed successfully Aug 13 09:36:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Acquiring lock "cinder-b91c7ea1-3014-446d-a47e-d9306bd14ca3-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "cinder-b91c7ea1-3014-446d-a47e-d9306bd14ca3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Acquiring lock "cinder-quobyte-e855f452-3c7c-424a-80ab-6fc834b5222e" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "cinder-quobyte-e855f452-3c7c-424a-80ab-6fc834b5222e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Acquiring lock "cinder-quobyte-b91c7ea1-3014-446d-a47e-d9306bd14ca3" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "cinder-quobyte-b91c7ea1-3014-446d-a47e-d9306bd14ca3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Deleting offline snapshot b91c7ea1-3014-446d-a47e-d9306bd14ca3 of volume e855f452-3c7c-424a-80ab-6fc834b5222e {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:36:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] snapshot_file for this snap is: volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:36:25 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4bcbd3-59a6-4363-8d17-cdd3efed118d]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:36:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:25 devstack sudo[112001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3 Aug 13 09:36:25 devstack sudo[112001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:25 devstack sudo[112001]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3" returned: 0 in 0.356s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e855f452-3c7c-424a-80ab-6fc834b5222e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:36:25 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d91fb1-d6d4-409b-bbd6-8901cb8584a1]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:36:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:25 devstack sudo[112006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e Aug 13 09:36:25 devstack sudo[112006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:26 devstack sudo[112006]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e" returned: 0 in 0.353s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:26 devstack sudo[112011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3 Aug 13 09:36:26 devstack sudo[112011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:26 devstack sudo[112011]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3" returned: 0 in 0.346s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:26 devstack sudo[112017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3 Aug 13 09:36:26 devstack sudo[112017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:26 devstack sudo[112017]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e.b91c7ea1-3014-446d-a47e-d9306bd14ca3" returned: 0 in 0.248s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "cinder-quobyte-b91c7ea1-3014-446d-a47e-d9306bd14ca3" released by "_delete_snapshot" :: held 1.398s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "cinder-quobyte-e855f452-3c7c-424a-80ab-6fc834b5222e" released by "delete_snapshot" :: held 1.420s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:26 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Created reservations ['ab72b54a-612b-492d-aafb-8a41f5bbabca', 'd40a8978-93d7-4c5e-922c-116759bab5d6', '3fc065a7-f77c-49f3-b32d-dd8c717e274d', 'cdffd65d-b41c-4ade-949f-b1d6d53e0cd6'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:36:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Delete snapshot completed successfully. Aug 13 09:36:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f50a6c5c-b696-45e2-9daf-371a3c74ac8d tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "cinder-b91c7ea1-3014-446d-a47e-d9306bd14ca3-delete_snapshot" released by "delete_snapshot" :: held 1.556s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Acquiring lock "cinder-e855f452-3c7c-424a-80ab-6fc834b5222e-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "cinder-e855f452-3c7c-424a-80ab-6fc834b5222e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Acquiring lock "cinder-quobyte-e855f452-3c7c-424a-80ab-6fc834b5222e" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "cinder-quobyte-e855f452-3c7c-424a-80ab-6fc834b5222e" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:27 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9031ce2f-c42e-47ee-bc96-c8fe72631f1f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:36:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:27 devstack sudo[112020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e Aug 13 09:36:27 devstack sudo[112020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:27 devstack sudo[112020]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e" returned: 0 in 0.356s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:27 devstack sudo[112025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e Aug 13 09:36:27 devstack sudo[112025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:28 devstack sudo[112025]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e855f452-3c7c-424a-80ab-6fc834b5222e" returned: 0 in 0.248s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "cinder-quobyte-e855f452-3c7c-424a-80ab-6fc834b5222e" released by "delete_volume" :: held 0.666s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:28 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Created reservations ['e39bcb3c-38ff-495d-88d5-a35c0df6ebcd', 'a7d3b609-e7f8-45f1-a1f4-3879379c71f4', '45301b3e-5568-468f-bc18-3cff527d4584', '3447a242-9178-4715-999e-ed4e5aaa4da3'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:36:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:36:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:36:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:28 devstack sudo[112028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:36:28 devstack sudo[112028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:28 devstack sudo[112028]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.272s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:28 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:36:28 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Deleted volume successfully. Aug 13 09:36:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2909c457-6bcd-4859-bd9e-1b28a063d873 tempest-SnapshotMetadataTestJSON-1592729616 None] Lock "cinder-e855f452-3c7c-424a-80ab-6fc834b5222e-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Flow 'volume_create_manager' (706b5a49-cb57-4bcf-9057-e689c662ed3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d2b813-30f0-4aae-8e1c-a57b45012011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d2b813-30f0-4aae-8e1c-a57b45012011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1947151134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb4414b6a7649b0a9ba7ed87ea8c36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:36:31Z,use_quota=True,user_id='4825123615f94f439c5724398f275839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd722b88-5535-4c74-8c30-d77915b17ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd722b88-5535-4c74-8c30-d77915b17ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9be795-5dbb-4fca-85fe-ee7ce2066e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9be795-5dbb-4fca-85fe-ee7ce2066e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7', 'volume_name': 'volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2402c8c-8bc4-4204-88b3-5683b9d1017a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2402c8c-8bc4-4204-88b3-5683b9d1017a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0602eb6-325b-4a0f-bc8f-eabc27d55953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:31 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Volume 5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7', 'volume_size': 1} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1947151134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb4414b6a7649b0a9ba7ed87ea8c36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:36:31Z,use_quota=True,user_id='4825123615f94f439c5724398f275839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Creating volume 5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:36:31 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:36:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:31 devstack sudo[112069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7 1073741824 Aug 13 09:36:31 devstack sudo[112069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:32 devstack sudo[112069]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7 1073741824" returned: 0 in 0.479s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:32 devstack sudo[112075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7 Aug 13 09:36:32 devstack sudo[112075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:32 devstack sudo[112075]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7" returned: 0 in 0.255s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:32 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:36:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0602eb6-325b-4a0f-bc8f-eabc27d55953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fa906e-f1a0-4aef-9d53-fa441f05ece7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:32 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Volume volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7 (5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7): created successfully Aug 13 09:36:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fa906e-f1a0-4aef-9d53-fa441f05ece7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Flow 'volume_create_manager' (706b5a49-cb57-4bcf-9057-e689c662ed3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:36:32 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-9c4fcc73-2df3-4299-99f7-e02b23fcd689 tempest-VolumesMetadataTest-1665737372 None] Created volume successfully. Aug 13 09:36:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Acquiring lock "cinder-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Lock "cinder-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Acquiring lock "cinder-quobyte-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Lock "cinder-quobyte-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:34 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a86928-eaf1-4764-b432-9657f8ab43b9]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:36:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:34 devstack sudo[112078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7 Aug 13 09:36:34 devstack sudo[112078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:34 devstack sudo[112078]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7" returned: 0 in 0.354s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:34 devstack sudo[112083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7 Aug 13 09:36:34 devstack sudo[112083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:34 devstack sudo[112083]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7" returned: 0 in 0.249s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Lock "cinder-quobyte-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7" released by "delete_volume" :: held 0.642s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:35 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Created reservations ['3b0d3043-6ca3-49f7-946e-202a8c18e2ac', '8e05b657-bb64-4ea3-a3d9-bb8bff92aaae', '17f478e1-a08a-4582-bcf8-41ecbd44d2a7', 'f4f61caf-e794-4c3f-9410-1fefd197e62a'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:36:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:36:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:36:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:35 devstack sudo[112086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:36:35 devstack sudo[112086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:35 devstack sudo[112086]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.244s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:35 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:36:35 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Deleted volume successfully. Aug 13 09:36:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-339cba57-5bb1-4700-bba0-75883127a14f tempest-VolumesMetadataTest-1665737372 None] Lock "cinder-5bfcd06f-0f6a-491a-9c17-76b8a8edc2d7-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Flow 'volume_create_manager' (31b19ae9-cb97-4d17-a535-a9181396e316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa3d4bf-88ec-473c-931d-6ec47f7a8696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa3d4bf-88ec-473c-931d-6ec47f7a8696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1527508164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb02e7a-abc5-4349-beb1-cc041af33e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9159b6498934de2be8aba7c03ab243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:36:39Z,use_quota=True,user_id='538179ac855845aea43432ea2939bd62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e039178-7bf1-4ca5-97e1-3de993f365db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e039178-7bf1-4ca5-97e1-3de993f365db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16d469d-2bf3-4768-a639-fa4ac0cfaaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16d469d-2bf3-4768-a639-fa4ac0cfaaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb02e7a-abc5-4349-beb1-cc041af33e16', 'volume_name': 'volume-cfb02e7a-abc5-4349-beb1-cc041af33e16', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92fd934a-9835-4f9e-aed4-79f79c840714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92fd934a-9835-4f9e-aed4-79f79c840714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40688173-1bda-432d-82b3-8952df1a0e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:39 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Volume cfb02e7a-abc5-4349-beb1-cc041af33e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb02e7a-abc5-4349-beb1-cc041af33e16', 'volume_size': 1} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1527508164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb02e7a-abc5-4349-beb1-cc041af33e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9159b6498934de2be8aba7c03ab243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:36:39Z,use_quota=True,user_id='538179ac855845aea43432ea2939bd62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Creating volume cfb02e7a-abc5-4349-beb1-cc041af33e16 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:36:39 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:36:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cfb02e7a-abc5-4349-beb1-cc041af33e16 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:39 devstack sudo[112095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cfb02e7a-abc5-4349-beb1-cc041af33e16 1073741824 Aug 13 09:36:39 devstack sudo[112095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:40 devstack sudo[112095]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cfb02e7a-abc5-4349-beb1-cc041af33e16 1073741824" returned: 0 in 0.452s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cfb02e7a-abc5-4349-beb1-cc041af33e16 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:40 devstack sudo[112102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cfb02e7a-abc5-4349-beb1-cc041af33e16 Aug 13 09:36:40 devstack sudo[112102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:40 devstack sudo[112102]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cfb02e7a-abc5-4349-beb1-cc041af33e16" returned: 0 in 0.247s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:36:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40688173-1bda-432d-82b3-8952df1a0e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb02e7a-abc5-4349-beb1-cc041af33e16', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00cff3d1-e29e-44e2-8230-ea9e8b990430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:40 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Volume volume-cfb02e7a-abc5-4349-beb1-cc041af33e16 (cfb02e7a-abc5-4349-beb1-cc041af33e16): created successfully Aug 13 09:36:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00cff3d1-e29e-44e2-8230-ea9e8b990430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Flow 'volume_create_manager' (31b19ae9-cb97-4d17-a535-a9181396e316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:36:40 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-a2fc4cd2-bd36-4eca-a0e6-d0faabfdbb25 tempest-VolumesTransfersV357Test-170858645 None] Created volume successfully. Aug 13 09:36:41 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-62463567-4c96-4c11-8324-1323bcf2897c tempest-VolumesTransfersV357Test-858057353 None] Transfer volume completed successfully. Aug 13 09:36:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Acquiring lock "cinder-cfb02e7a-abc5-4349-beb1-cc041af33e16-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Lock "cinder-cfb02e7a-abc5-4349-beb1-cc041af33e16-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Acquiring lock "cinder-quobyte-cfb02e7a-abc5-4349-beb1-cc041af33e16" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Lock "cinder-quobyte-cfb02e7a-abc5-4349-beb1-cc041af33e16" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:41 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e366f0-7438-4d31-9676-7e1cf07121e3]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:36:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cfb02e7a-abc5-4349-beb1-cc041af33e16 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:41 devstack sudo[112105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cfb02e7a-abc5-4349-beb1-cc041af33e16 Aug 13 09:36:41 devstack sudo[112105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:41 devstack sudo[112105]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cfb02e7a-abc5-4349-beb1-cc041af33e16" returned: 0 in 0.365s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cfb02e7a-abc5-4349-beb1-cc041af33e16 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:42 devstack sudo[112110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cfb02e7a-abc5-4349-beb1-cc041af33e16 Aug 13 09:36:42 devstack sudo[112110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:42 devstack sudo[112110]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cfb02e7a-abc5-4349-beb1-cc041af33e16" returned: 0 in 0.256s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Lock "cinder-quobyte-cfb02e7a-abc5-4349-beb1-cc041af33e16" released by "delete_volume" :: held 0.664s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:42 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Created reservations ['d89bdc99-2508-486c-87f7-cbe4d12d07a4', '871d83b6-feda-4ff5-9997-386cda907c35', '194912f1-ed8c-4995-9e77-89f35ff4246c', '3d86c689-d26d-4e8e-90cc-e1a3b5ad826c'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:36:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:36:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:36:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:42 devstack sudo[112113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:36:42 devstack sudo[112113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:42 devstack sudo[112113]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.262s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:42 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:36:42 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Deleted volume successfully. Aug 13 09:36:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-fb59d821-cdf7-4e76-b547-0700b867a3f8 tempest-VolumesTransfersV357Test-663318931 None] Lock "cinder-cfb02e7a-abc5-4349-beb1-cc041af33e16-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Flow 'volume_create_manager' (172b8c12-85fe-44b7-8fa7-0ece69a3f1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30bb594a-b7eb-45ef-8570-05fb8e7049cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:43 devstack sudo[112116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:36:43 devstack sudo[112116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30bb594a-b7eb-45ef-8570-05fb8e7049cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2017759047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc6ea55-a821-4a1a-9fe0-b75f882ebd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9159b6498934de2be8aba7c03ab243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:36:43Z,use_quota=True,user_id='538179ac855845aea43432ea2939bd62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b49651-312c-4c02-b753-54493c1e588b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b49651-312c-4c02-b753-54493c1e588b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c9e213-0914-4a3a-be7d-5f0eb77c17d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c9e213-0914-4a3a-be7d-5f0eb77c17d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bc6ea55-a821-4a1a-9fe0-b75f882ebd38', 'volume_name': 'volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaef3556-2b11-4e6e-b411-956a04356c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaef3556-2b11-4e6e-b411-956a04356c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ab52ee-92f3-4eb3-b755-df15c1774ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:43 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Volume 6bc6ea55-a821-4a1a-9fe0-b75f882ebd38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38', 'volume_size': 1} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2017759047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc6ea55-a821-4a1a-9fe0-b75f882ebd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9159b6498934de2be8aba7c03ab243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:36:43Z,use_quota=True,user_id='538179ac855845aea43432ea2939bd62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Creating volume 6bc6ea55-a821-4a1a-9fe0-b75f882ebd38 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:36:43 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:43 devstack sudo[112118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38 1073741824 Aug 13 09:36:43 devstack sudo[112118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:43 devstack sudo[112116]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.248s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:36:43 devstack sudo[112118]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38 1073741824" returned: 0 in 0.469s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:43 devstack sudo[112124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38 Aug 13 09:36:43 devstack sudo[112124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:44 devstack sudo[112124]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38" returned: 0 in 0.251s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:36:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ab52ee-92f3-4eb3-b755-df15c1774ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07faf67-a607-4b31-9500-41e5ccbceaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:36:44 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Volume volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38 (6bc6ea55-a821-4a1a-9fe0-b75f882ebd38): created successfully Aug 13 09:36:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07faf67-a607-4b31-9500-41e5ccbceaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:36:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Flow 'volume_create_manager' (172b8c12-85fe-44b7-8fa7-0ece69a3f1b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:36:44 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-702d3c69-b548-444b-a053-5fdf537d0095 tempest-VolumesTransfersV357Test-170858645 None] Created volume successfully. Aug 13 09:36:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Acquiring lock "cinder-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Lock "cinder-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Acquiring lock "cinder-quobyte-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Lock "cinder-quobyte-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38" acquired by "delete_volume" :: waited 0.014s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:44 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[041e55d3-476a-4339-9cd3-7a57b11a9da2]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:36:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:44 devstack sudo[112127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38 Aug 13 09:36:44 devstack sudo[112127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:44 devstack sudo[112127]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38" returned: 0 in 0.362s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:44 devstack sudo[112132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38 Aug 13 09:36:44 devstack sudo[112132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:45 devstack sudo[112132]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38" returned: 0 in 0.256s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Lock "cinder-quobyte-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38" released by "delete_volume" :: held 0.658s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:45 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Created reservations ['d12e436b-a576-4881-9c09-337ece3c305a', 'ce21f315-24b7-445a-bf5d-373d4b477538', '02956eab-cfbe-4a6f-8d07-24aa1da4a374', 'f8a58ce4-e524-47ee-9bde-f820a720fbec'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:36:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:36:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:36:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:45 devstack sudo[112135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:36:45 devstack sudo[112135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:45 devstack sudo[112135]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.239s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:45 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:36:45 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Deleted volume successfully. Aug 13 09:36:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3b6affdd-dabd-49d5-85b9-ba62ba8999ae tempest-VolumesTransfersV357Test-663318931 None] Lock "cinder-6bc6ea55-a821-4a1a-9fe0-b75f882ebd38-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-e53c47ee-5ecb-4fc4-899a-6d0110018fdc req-b092a980-bf0c-4ab8-a4c8-2c7a7910d776 tempest-TestStampPattern-196712714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-e53c47ee-5ecb-4fc4-899a-6d0110018fdc req-b092a980-bf0c-4ab8-a4c8-2c7a7910d776 tempest-TestStampPattern-196712714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:48 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e732bfbc-8301-43a1-b198-59220210e06b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:36:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-e53c47ee-5ecb-4fc4-899a-6d0110018fdc req-b092a980-bf0c-4ab8-a4c8-2c7a7910d776 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:48 devstack sudo[112153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d Aug 13 09:36:48 devstack sudo[112153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:48 devstack sudo[112153]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-e53c47ee-5ecb-4fc4-899a-6d0110018fdc req-b092a980-bf0c-4ab8-a4c8-2c7a7910d776 tempest-TestStampPattern-196712714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d" returned: 0 in 0.408s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-e53c47ee-5ecb-4fc4-899a-6d0110018fdc req-b092a980-bf0c-4ab8-a4c8-2c7a7910d776 tempest-TestStampPattern-196712714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.433s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-e53c47ee-5ecb-4fc4-899a-6d0110018fdc req-b092a980-bf0c-4ab8-a4c8-2c7a7910d776 tempest-TestStampPattern-196712714 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '373556fd-b74c-4182-8e2b-db7078317463', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:36:48 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-e53c47ee-5ecb-4fc4-899a-6d0110018fdc req-b092a980-bf0c-4ab8-a4c8-2c7a7910d776 tempest-TestStampPattern-196712714 None] attachment_update completed successfully. Aug 13 09:36:51 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-8bc2aa8a-9cdb-4146-8d50-b32db8ee573d req-b6fe18b1-ac91-402b-ada9-1e7ebcc17147 tempest-TestStampPattern-196712714 None] Terminate volume connection completed successfully. Aug 13 09:36:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-8bc2aa8a-9cdb-4146-8d50-b32db8ee573d req-b6fe18b1-ac91-402b-ada9-1e7ebcc17147 tempest-TestStampPattern-196712714 None] Deleting attachment 373556fd-b74c-4182-8e2b-db7078317463. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:36:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Acquiring lock "cinder-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Lock "cinder-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Acquiring lock "cinder-quobyte-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Lock "cinder-quobyte-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:56 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b22d87-4fee-4f67-8cbd-822b51ba8619]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:36:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:56 devstack sudo[112636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d Aug 13 09:36:56 devstack sudo[112636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:56 devstack sudo[112636]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d" returned: 0 in 0.466s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:56 devstack sudo[112641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d Aug 13 09:36:56 devstack sudo[112641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:56 devstack sudo[112641]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d" returned: 0 in 0.289s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Lock "cinder-quobyte-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d" released by "delete_volume" :: held 0.808s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Created reservations ['54fb09b7-892b-41ed-a194-2d985e7aee8c', '7aa5dd6f-bfa9-49d1-95c7-99e8fe2ce806', '9cb1f4c6-eb22-4cf4-bbcc-2aa128b30e3e', '2d0526c1-8281-4944-853f-ea50153d14a3'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:57 devstack sudo[112644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:36:57 devstack sudo[112644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:57 devstack sudo[112644]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.294s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:36:57 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Deleted volume successfully. Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9f217e8c-0032-4bdd-b8fb-6c34fa2357ba tempest-TestStampPattern-196712714 None] Lock "cinder-e95b270a-3c24-4ebe-a4ea-fdafdc3ffa1d-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Acquiring lock "cinder-17f0c4a1-8778-4993-9f4b-374cbaed7974-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Lock "cinder-17f0c4a1-8778-4993-9f4b-374cbaed7974-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Acquiring lock "cinder-quobyte-be21228c-a653-4e08-ac38-251cdad1889d" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Lock "cinder-quobyte-be21228c-a653-4e08-ac38-251cdad1889d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Acquiring lock "cinder-quobyte-17f0c4a1-8778-4993-9f4b-374cbaed7974" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Lock "cinder-quobyte-17f0c4a1-8778-4993-9f4b-374cbaed7974" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Deleting offline snapshot 17f0c4a1-8778-4993-9f4b-374cbaed7974 of volume be21228c-a653-4e08-ac38-251cdad1889d {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] snapshot_file for this snap is: volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[8536c446-ed55-423e-9fa4-4c9ac465713c]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:36:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:57 devstack sudo[112647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 Aug 13 09:36:57 devstack sudo[112647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:58 devstack sudo[112647]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974" returned: 0 in 0.430s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be21228c-a653-4e08-ac38-251cdad1889d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:36:58 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef4377b-124d-48f2-802d-77302006c0ac]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:36:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:58 devstack sudo[112653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d Aug 13 09:36:58 devstack sudo[112653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:58 devstack sudo[112653]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d" returned: 0 in 0.435s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:58 devstack sudo[112658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 Aug 13 09:36:58 devstack sudo[112658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:59 devstack sudo[112658]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974" returned: 0 in 0.442s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:36:59 devstack sudo[112664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974 Aug 13 09:36:59 devstack sudo[112664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:36:59 devstack sudo[112664]: pam_unix(sudo:session): session closed for user root Aug 13 09:36:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d.17f0c4a1-8778-4993-9f4b-374cbaed7974" returned: 0 in 0.294s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:36:59 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Lock "cinder-quobyte-17f0c4a1-8778-4993-9f4b-374cbaed7974" released by "_delete_snapshot" :: held 1.751s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:59 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Lock "cinder-quobyte-be21228c-a653-4e08-ac38-251cdad1889d" released by "delete_snapshot" :: held 1.780s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:36:59 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Created reservations ['373020cb-5326-49ad-8217-dc9b7c05337e', 'b1b54134-cd69-4d0f-a5b4-0b9d89f84aed', '9de63c14-c3f3-4204-be91-d866edb65e64', '2ffb2ed8-4df2-4f28-a6d4-311d23eae051'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:36:59 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Delete snapshot completed successfully. Aug 13 09:36:59 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2fd7ce7e-6f33-4eff-8e54-ac9ee67cf9cd tempest-TestStampPattern-196712714 None] Lock "cinder-17f0c4a1-8778-4993-9f4b-374cbaed7974-delete_snapshot" released by "delete_snapshot" :: held 1.952s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Acquiring lock "cinder-be21228c-a653-4e08-ac38-251cdad1889d-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Lock "cinder-be21228c-a653-4e08-ac38-251cdad1889d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Acquiring lock "cinder-quobyte-be21228c-a653-4e08-ac38-251cdad1889d" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Lock "cinder-quobyte-be21228c-a653-4e08-ac38-251cdad1889d" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55a1636-90d6-400a-90b5-8ce5ff7358bd]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Flow 'volume_create_manager' (532b36b2-ea93-4579-b3be-6a106e7b3137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b52913-8528-41c6-b565-dca69642d023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b52913-8528-41c6-b565-dca69642d023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1261253886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbeaeeb4c7fe4b8fabc0c8bea3fec62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:37:04Z,use_quota=True,user_id='189debc41b9a49f7b1b2729bbc1c3c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14be7662-5930-409a-83fb-505d82df4e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14be7662-5930-409a-83fb-505d82df4e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:04 devstack sudo[112699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb3e492-fedd-4016-8043-4cb1d526719c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:04 devstack sudo[112699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb3e492-fedd-4016-8043-4cb1d526719c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc', 'volume_name': 'volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252340d6-266c-481f-ba86-678431fee1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252340d6-266c-481f-ba86-678431fee1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5406ac-2492-485a-a8c5-68bf37b3d01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:04 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Volume a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc', 'volume_size': 1} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1261253886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbeaeeb4c7fe4b8fabc0c8bea3fec62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:37:04Z,use_quota=True,user_id='189debc41b9a49f7b1b2729bbc1c3c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Creating volume a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:37:04 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:04 devstack sudo[112701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc 1073741824 Aug 13 09:37:04 devstack sudo[112701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:04 devstack sudo[112699]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d" returned: 0 in 0.425s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:04 devstack sudo[112709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d Aug 13 09:37:04 devstack sudo[112709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:05 devstack sudo[112701]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc 1073741824" returned: 0 in 0.460s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:05 devstack sudo[112713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc Aug 13 09:37:05 devstack sudo[112713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:05 devstack sudo[112709]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-be21228c-a653-4e08-ac38-251cdad1889d" returned: 0 in 0.276s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Lock "cinder-quobyte-be21228c-a653-4e08-ac38-251cdad1889d" released by "delete_volume" :: held 0.767s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Created reservations ['5abccb83-a5b8-4352-bc08-b219fb994aa5', '32deaed9-2dcd-4134-8377-ed10e6abeb82', 'd42a27bb-a804-4c40-a17c-9857817821a4', '310aae0f-1f0a-4599-83e9-477bc7b942e3'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:05 devstack sudo[112715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:37:05 devstack sudo[112715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:05 devstack sudo[112713]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" returned: 0 in 0.271s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5406ac-2492-485a-a8c5-68bf37b3d01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b143473b-fccd-4384-aaed-50f367d91576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:05 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Volume volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc (a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc): created successfully Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b143473b-fccd-4384-aaed-50f367d91576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Flow 'volume_create_manager' (532b36b2-ea93-4579-b3be-6a106e7b3137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:37:05 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-51ef9aea-5600-4e2e-8f13-513c64b61974 tempest-VolumesActionsTest-251533333 None] Created volume successfully. Aug 13 09:37:05 devstack sudo[112715]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.262s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:37:05 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Deleted volume successfully. Aug 13 09:37:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-03c73219-6498-4f04-a6a9-a9e4f9cf6e90 tempest-TestStampPattern-196712714 None] Lock "cinder-be21228c-a653-4e08-ac38-251cdad1889d-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:37:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-0109a7a2-b36d-4ee3-bab7-9ccf1b2299d3 tempest-VolumesActionsTest-251533333 None] Acquiring lock "cinder-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" by "attach_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:37:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-0109a7a2-b36d-4ee3-bab7-9ccf1b2299d3 tempest-VolumesActionsTest-251533333 None] Lock "cinder-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" acquired by "attach_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:37:14 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-0109a7a2-b36d-4ee3-bab7-9ccf1b2299d3 tempest-VolumesActionsTest-251533333 None] Attaching volume a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc to instance ecc4f796-ee7c-4068-88ed-7c18d33f9c77 at mountpoint /dev/vdb on host None. Aug 13 09:37:14 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-0109a7a2-b36d-4ee3-bab7-9ccf1b2299d3 tempest-VolumesActionsTest-251533333 None] Attach volume completed successfully. Aug 13 09:37:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-0109a7a2-b36d-4ee3-bab7-9ccf1b2299d3 tempest-VolumesActionsTest-251533333 None] Lock "cinder-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" released by "attach_volume" :: held 0.106s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:37:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3b25aaab-dc83-445f-8ad9-695e1a0d2f11 tempest-VolumesActionsTest-251533333 None] Acquiring lock "cinder-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc-detach_volume" by "detach_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:37:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3b25aaab-dc83-445f-8ad9-695e1a0d2f11 tempest-VolumesActionsTest-251533333 None] Lock "cinder-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:37:14 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3b25aaab-dc83-445f-8ad9-695e1a0d2f11 tempest-VolumesActionsTest-251533333 None] Detaching volume a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc from instance ecc4f796-ee7c-4068-88ed-7c18d33f9c77. Aug 13 09:37:14 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3b25aaab-dc83-445f-8ad9-695e1a0d2f11 tempest-VolumesActionsTest-251533333 None] Detach volume completed successfully. Aug 13 09:37:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3b25aaab-dc83-445f-8ad9-695e1a0d2f11 tempest-VolumesActionsTest-251533333 None] Lock "cinder-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc-detach_volume" released by "detach_volume" :: held 0.068s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:37:24 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=83,cinder:SELECT=67,cinder:INSERT=22,cinder:DELETE=4 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:37:24 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=70,cinder:UPDATE=78,cinder:DELETE=8,cinder:INSERT=18 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:37:24 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:37:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Flow 'volume_create_manager' (95e983c4-3b1f-41d0-9939-68c9b8086c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:37:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953f0a7f-6065-42ce-a41a-30d667474ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953f0a7f-6065-42ce-a41a-30d667474ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba3c741-83ae-48cd-b410-ed086ef4c81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cbe736c76364c068405a91ec1b3b5ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:37:25Z,use_quota=True,user_id='9131785d7a79434dbef13cc6eecd8555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4eebb30-e0f4-4d92-8f95-dce22335ab1a),volume_type_id=e4eebb30-e0f4-4d92-8f95-dce22335ab1a)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f023ab-585f-41ea-929c-664683060c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f023ab-585f-41ea-929c-664683060c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7a1ed8-d6f4-4428-b06c-ecefec40b2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:24 devstack cinder-volume[94670]: DEBUG cinder.image.glance [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Creating Keystone auth plugin from conf {{(pid=94670) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 13 09:37:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7a1ed8-d6f4-4428-b06c-ecefec40b2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5ba3c741-83ae-48cd-b410-ed086ef4c81f', 'volume_name': 'volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f', 'volume_size': 1, 'image_id': '53cb2a94-b960-42e0-a45a-9c933b1572ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53cb2a94-b960-42e0-a45a-9c933b1572ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3018e13d63fa2209128c4a1b51555a88', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6cbe736c76364c068405a91ec1b3b5ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '842d77bb491cba837a07b3ae5a686c1317b8ccb552acd28dbd7737e8c7e3b091ff62ab9865fb44055c2f84382efdddc2bd4e7ef4e9ef411ffcb4d5210a59124f', 'id': '53cb2a94-b960-42e0-a45a-9c933b1572ab', 'created_at': datetime.datetime(2026, 8, 13, 7, 37, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 37, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53cb2a94-b960-42e0-a45a-9c933b1572ab/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90ad75e-73fb-4a05-ac24-4c51e49b42ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90ad75e-73fb-4a05-ac24-4c51e49b42ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106d7360-bc87-4215-801e-62041fbfa599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:25 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Volume 5ba3c741-83ae-48cd-b410-ed086ef4c81f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f', 'volume_size': 1, 'image_id': '53cb2a94-b960-42e0-a45a-9c933b1572ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53cb2a94-b960-42e0-a45a-9c933b1572ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3018e13d63fa2209128c4a1b51555a88', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6cbe736c76364c068405a91ec1b3b5ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '842d77bb491cba837a07b3ae5a686c1317b8ccb552acd28dbd7737e8c7e3b091ff62ab9865fb44055c2f84382efdddc2bd4e7ef4e9ef411ffcb4d5210a59124f', 'id': '53cb2a94-b960-42e0-a45a-9c933b1572ab', 'created_at': datetime.datetime(2026, 8, 13, 7, 37, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 37, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53cb2a94-b960-42e0-a45a-9c933b1572ab/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 13 09:37:25 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Trying to clone 5ba3c741-83ae-48cd-b410-ed086ef4c81f from image 53cb2a94-b960-42e0-a45a-9c933b1572ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/53cb2a94-b960-42e0-a45a-9c933b1572ab', 'metadata': {}}]). {{(pid=94670) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 13 09:37:25 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 13 09:37:25 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Image download 0.00 MB at 0.00 MB/s Aug 13 09:37:25 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8c3c25-a70b-4977-903c-76d632055d22]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:37:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:25 devstack sudo[112962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD Aug 13 09:37:25 devstack sudo[112962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:25 devstack sudo[112962]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:25 devstack sudo[112966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD Aug 13 09:37:25 devstack sudo[112966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:26 devstack sudo[112966]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:37:26 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Temporary image 53cb2a94-b960-42e0-a45a-9c933b1572ab is fetched for user 9131785d7a79434dbef13cc6eecd8555. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 13 09:37:26 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf9453f-7a47-4a77-ae61-a152f7578028]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:37:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3926995b-f2c0-4bd5-8d34-62d6b07cc0a9 tempest-VolumesActionsTest-251533333 None] Acquiring lock "cinder-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" by "attach_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:37:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3926995b-f2c0-4bd5-8d34-62d6b07cc0a9 tempest-VolumesActionsTest-251533333 None] Lock "cinder-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" acquired by "attach_volume" :: waited 0.035s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:37:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3926995b-f2c0-4bd5-8d34-62d6b07cc0a9 tempest-VolumesActionsTest-251533333 None] Attaching volume a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc to instance a9b6bd19-14aa-4337-8d38-2087a32683f3 at mountpoint /dev/vdb on host None. Aug 13 09:37:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3926995b-f2c0-4bd5-8d34-62d6b07cc0a9 tempest-VolumesActionsTest-251533333 None] Attach volume completed successfully. Aug 13 09:37:26 devstack sudo[112971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD Aug 13 09:37:26 devstack sudo[112971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3926995b-f2c0-4bd5-8d34-62d6b07cc0a9 tempest-VolumesActionsTest-251533333 None] Lock "cinder-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" released by "attach_volume" :: held 0.142s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:37:26 devstack sudo[112971]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-93643261-ee1d-453a-bde2-8e39b603025b tempest-VolumesActionsTest-251533333 None] Acquiring lock "cinder-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc-detach_volume" by "detach_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:37:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-93643261-ee1d-453a-bde2-8e39b603025b tempest-VolumesActionsTest-251533333 None] Lock "cinder-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:37:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-93643261-ee1d-453a-bde2-8e39b603025b tempest-VolumesActionsTest-251533333 None] Detaching volume a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc from instance a9b6bd19-14aa-4337-8d38-2087a32683f3. Aug 13 09:37:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-93643261-ee1d-453a-bde2-8e39b603025b tempest-VolumesActionsTest-251533333 None] Detach volume completed successfully. Aug 13 09:37:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-93643261-ee1d-453a-bde2-8e39b603025b tempest-VolumesActionsTest-251533333 None] Lock "cinder-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:37:26 devstack sudo[112975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD Aug 13 09:37:26 devstack sudo[112975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:27 devstack sudo[112975]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD" returned: 1 in 0.454s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:37:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:37:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba3c741-83ae-48cd-b410-ed086ef4c81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cbe736c76364c068405a91ec1b3b5ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:37:25Z,use_quota=True,user_id='9131785d7a79434dbef13cc6eecd8555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4eebb30-e0f4-4d92-8f95-dce22335ab1a),volume_type_id=e4eebb30-e0f4-4d92-8f95-dce22335ab1a)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:37:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Creating volume 5ba3c741-83ae-48cd-b410-ed086ef4c81f {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:37:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:37:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:37:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:37:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:37:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:37:27 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:37:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:27 devstack sudo[112980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f 1073741824 Aug 13 09:37:27 devstack sudo[112980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:27 devstack sudo[112980]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f 1073741824" returned: 0 in 0.548s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:27 devstack sudo[113001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f Aug 13 09:37:27 devstack sudo[113001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:28 devstack sudo[113001]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f" returned: 0 in 0.352s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:37:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:37:28 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Attempting download of 53cb2a94-b960-42e0-a45a-9c933b1572ab ((None, [{'url': 'file:///opt/stack/data/glance/images/53cb2a94-b960-42e0-a45a-9c933b1572ab', 'metadata': {}}])) to volume 5ba3c741-83ae-48cd-b410-ed086ef4c81f. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 13 09:37:28 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fafa698-fc18-4aa8-b43e-654461d4d7e0]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:37:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53cb2a94-b960-42e0-a45a-9c933b1572ab_fw8vmp8b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:28 devstack sudo[113014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53cb2a94-b960-42e0-a45a-9c933b1572ab_fw8vmp8b Aug 13 09:37:28 devstack sudo[113014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:28 devstack sudo[113014]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53cb2a94-b960-42e0-a45a-9c933b1572ab_fw8vmp8b" returned: 0 in 0.467s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53cb2a94-b960-42e0-a45a-9c933b1572ab_fw8vmp8b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:28 devstack sudo[113020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53cb2a94-b960-42e0-a45a-9c933b1572ab_fw8vmp8b Aug 13 09:37:28 devstack sudo[113020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:29 devstack sudo[113020]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53cb2a94-b960-42e0-a45a-9c933b1572ab_fw8vmp8b" returned: 1 in 0.352s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53cb2a94-b960-42e0-a45a-9c933b1572ab_fw8vmp8b' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:37:29 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f620b1fc-1752-4635-9c3c-d5806e13e241]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:37:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:29 devstack sudo[113024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD Aug 13 09:37:29 devstack sudo[113024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:29 devstack sudo[113024]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:29 devstack sudo[113028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD Aug 13 09:37:29 devstack sudo[113028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:29 devstack sudo[113028]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:37:29 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] 53cb2a94-b960-42e0-a45a-9c933b1572ab was raw, converting to raw {{(pid=94670) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 13 09:37:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:29 devstack sudo[113033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f Aug 13 09:37:29 devstack sudo[113033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:30 devstack sudo[113033]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f" returned: 0 in 0.400s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:30 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_53cb2a94-b960-42e0-a45a-9c933b1572ab_o4pxwcovdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:37:30 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Converted 0.00 MB image at 0.00 MB/s Aug 13 09:37:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:30 devstack sudo[113039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f 1G Aug 13 09:37:30 devstack sudo[113039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:30 devstack sudo[113039]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f 1G" returned: 0 in 0.358s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:30 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b8dbac-a058-4c12-b851-b986d6be4f08]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:37:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:30 devstack sudo[113044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f Aug 13 09:37:30 devstack sudo[113044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:30 devstack sudo[113044]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f" returned: 0 in 0.375s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:31 devstack sudo[113048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f Aug 13 09:37:31 devstack sudo[113048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:31 devstack sudo[113048]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f" returned: 1 in 0.394s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Downloaded image 53cb2a94-b960-42e0-a45a-9c933b1572ab ((None, [{'url': 'file:///opt/stack/data/glance/images/53cb2a94-b960-42e0-a45a-9c933b1572ab', 'metadata': {}}])) to volume 5ba3c741-83ae-48cd-b410-ed086ef4c81f successfully. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Temporary image 53cb2a94-b960-42e0-a45a-9c933b1572ab for user 9131785d7a79434dbef13cc6eecd8555 is deleted. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Marking volume 5ba3c741-83ae-48cd-b410-ed086ef4c81f as bootable. {{(pid=94670) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Copying metadata from image 53cb2a94-b960-42e0-a45a-9c933b1572ab to 5ba3c741-83ae-48cd-b410-ed086ef4c81f. {{(pid=94670) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Creating volume glance metadata for volume 5ba3c741-83ae-48cd-b410-ed086ef4c81f backed by image 53cb2a94-b960-42e0-a45a-9c933b1572ab with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '53cb2a94-b960-42e0-a45a-9c933b1572ab', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3018e13d63fa2209128c4a1b51555a88', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94670) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106d7360-bc87-4215-801e-62041fbfa599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f', 'volume_size': 1, 'image_id': '53cb2a94-b960-42e0-a45a-9c933b1572ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53cb2a94-b960-42e0-a45a-9c933b1572ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3018e13d63fa2209128c4a1b51555a88', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6cbe736c76364c068405a91ec1b3b5ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '842d77bb491cba837a07b3ae5a686c1317b8ccb552acd28dbd7737e8c7e3b091ff62ab9865fb44055c2f84382efdddc2bd4e7ef4e9ef411ffcb4d5210a59124f', 'id': '53cb2a94-b960-42e0-a45a-9c933b1572ab', 'created_at': datetime.datetime(2026, 8, 13, 7, 37, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 37, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53cb2a94-b960-42e0-a45a-9c933b1572ab/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1323386d-d9ac-4b73-aed0-baf27a79d40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:37:31 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Volume volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f (5ba3c741-83ae-48cd-b410-ed086ef4c81f): created successfully Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1323386d-d9ac-4b73-aed0-baf27a79d40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Flow 'volume_create_manager' (95e983c4-3b1f-41d0-9939-68c9b8086c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[27016645-33bd-4f2f-8cba-2405465b6698]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:31 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e08be2b5-e35b-4d05-82d9-4f778749b203 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Created volume successfully. Aug 13 09:37:31 devstack sudo[113089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc Aug 13 09:37:31 devstack sudo[113089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:31 devstack sudo[113089]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" returned: 0 in 0.388s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f89fc8-2e48-4e35-a148-082b16168827]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:37:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:31 devstack sudo[113094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc Aug 13 09:37:31 devstack sudo[113094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:32 devstack sudo[113094]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" returned: 0 in 0.367s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.d0ee48f2-0d2d-4726-bfad-d1ba8f874d3481rbzdtl.img {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Acquiring lock "cinder-5ba3c741-83ae-48cd-b410-ed086ef4c81f-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:37:32 devstack sudo[113099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.d0ee48f2-0d2d-4726-bfad-d1ba8f874d3481rbzdtl.img Aug 13 09:37:32 devstack sudo[113099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Lock "cinder-5ba3c741-83ae-48cd-b410-ed086ef4c81f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:37:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Acquiring lock "cinder-quobyte-5ba3c741-83ae-48cd-b410-ed086ef4c81f" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:37:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Lock "cinder-quobyte-5ba3c741-83ae-48cd-b410-ed086ef4c81f" acquired by "delete_volume" :: waited 0.013s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:37:32 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2551e396-0e3e-4991-89f4-2297829881ca]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:37:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:32 devstack sudo[113101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f Aug 13 09:37:32 devstack sudo[113101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:32 devstack sudo[113101]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f" returned: 0 in 0.613s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:33 devstack sudo[113116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f Aug 13 09:37:33 devstack sudo[113116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:33 devstack sudo[113116]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f" returned: 1 in 0.849s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:37:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:33 devstack sudo[113121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f Aug 13 09:37:33 devstack sudo[113121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:34 devstack sudo[113121]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-5ba3c741-83ae-48cd-b410-ed086ef4c81f" returned: 0 in 1.170s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Lock "cinder-quobyte-5ba3c741-83ae-48cd-b410-ed086ef4c81f" released by "delete_volume" :: held 2.728s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:37:35 devstack cinder-volume[94670]: WARNING cinder.quota [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:37:35 devstack cinder-volume[94670]: WARNING cinder.quota [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 13 09:37:35 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Created reservations ['c6f3b6c7-75b7-4983-bee2-ddfa450193d5', '73ddcb9e-c7bd-4da1-b35d-9c27d026d699', '2a01cac4-5e69-4eec-93af-d6dc640bce00', 'be54a8fe-f4e3-4175-b64d-90304695af61'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:37:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:37:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:37:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:37:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:37:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:35 devstack sudo[113125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:37:35 devstack sudo[113125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:35 devstack sudo[113125]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.509s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:35 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:37:35 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Deleted volume successfully. Aug 13 09:37:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-261807e7-7ced-45e0-b59a-7bac6667e982 tempest-VolumeAndVolumeTypeFromImageTest-1205475298 None] Lock "cinder-5ba3c741-83ae-48cd-b410-ed086ef4c81f-delete_volume" released by "delete_volume" :: held 3.764s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:37:36 devstack sudo[113099]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.d0ee48f2-0d2d-4726-bfad-d1ba8f874d3481rbzdtl.img" returned: 0 in 4.627s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:36 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[259e481c-0271-4b68-a4ad-db4203d66f7b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:37:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:36 devstack sudo[113128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc Aug 13 09:37:36 devstack sudo[113128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:37 devstack sudo[113128]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" returned: 0 in 0.584s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:37 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] Image conversion details: src /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc, size 1024.00 MB, duration 4.63 sec, destination /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.d0ee48f2-0d2d-4726-bfad-d1ba8f874d3481rbzdtl.img {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:37:37 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] Converted 1024.00 MB image at 221.24 MB/s Aug 13 09:37:37 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] d0ee48f2-0d2d-4726-bfad-d1ba8f874d34 was raw, no need to convert to raw {{(pid=94670) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 13 09:37:41 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:37:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Flow 'volume_create_manager' (e1bbed86-0084-4244-8507-e9540888fd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:37:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ebeb1f-60ff-4870-848b-6a01a432420f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ebeb1f-60ff-4870-848b-6a01a432420f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1485988834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393e05fc-74be-4948-9f05-40df6f402a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86f25c3a010411582d839acb7d76131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:37:42Z,use_quota=True,user_id='8ad6a7b7cdd04a29b7b9c266e16647c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5023d0-effa-4769-9b6a-26b1feebedf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5023d0-effa-4769-9b6a-26b1feebedf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ca9081-c9a6-4f8f-bd4c-229e360a3371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ca9081-c9a6-4f8f-bd4c-229e360a3371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '393e05fc-74be-4948-9f05-40df6f402a9b', 'volume_name': 'volume-393e05fc-74be-4948-9f05-40df6f402a9b', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc0e729-8b0f-4ce8-ad4c-443a3b96f214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc0e729-8b0f-4ce8-ad4c-443a3b96f214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3367dbdc-30f6-4673-a1cf-537a8aa26b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:41 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Volume 393e05fc-74be-4948-9f05-40df6f402a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-393e05fc-74be-4948-9f05-40df6f402a9b', 'volume_size': 1} Aug 13 09:37:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Flow 'volume_create_manager' (f5120041-353a-4102-8f13-df2b72b937fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8597b9-2a47-440c-8a1e-238a15f61953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8597b9-2a47-440c-8a1e-238a15f61953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1983246055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7cf917-fbf6-4181-96d7-d49b147a38a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86f25c3a010411582d839acb7d76131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:37:42Z,use_quota=True,user_id='8ad6a7b7cdd04a29b7b9c266e16647c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fdc8b9f-a764-4040-9d01-56682687656e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fdc8b9f-a764-4040-9d01-56682687656e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8762b68-083e-4772-8a18-2c58ddeef222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8762b68-083e-4772-8a18-2c58ddeef222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7cf917-fbf6-4181-96d7-d49b147a38a6', 'volume_name': 'volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd0d718-7521-4f2c-bad4-6335c842c93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd0d718-7521-4f2c-bad4-6335c842c93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e7a7a5-9d4b-4ed1-9e7e-b40a63732d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:42 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Volume 7a7cf917-fbf6-4181-96d7-d49b147a38a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6', 'volume_size': 1} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Flow 'volume_create_manager' (f239a161-8e5a-48ef-8eff-9a6f4d43a2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b28421-b1c9-442a-9a6b-8442fef45b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b28421-b1c9-442a-9a6b-8442fef45b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1542029191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752fceb7-2638-469b-b3a9-992eab5da68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86f25c3a010411582d839acb7d76131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:37:42Z,use_quota=True,user_id='8ad6a7b7cdd04a29b7b9c266e16647c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7092baa8-2fd6-4698-a3a5-aa0d2c41b7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7092baa8-2fd6-4698-a3a5-aa0d2c41b7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551a960d-6b18-4e38-8fd4-01cd24dfbbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551a960d-6b18-4e38-8fd4-01cd24dfbbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '752fceb7-2638-469b-b3a9-992eab5da68a', 'volume_name': 'volume-752fceb7-2638-469b-b3a9-992eab5da68a', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388b3680-908d-4a4c-a2d8-7fb78772c7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388b3680-908d-4a4c-a2d8-7fb78772c7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1dcc7c7-fda7-496a-b20d-1a23b43c1a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:42 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Volume 752fceb7-2638-469b-b3a9-992eab5da68a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-752fceb7-2638-469b-b3a9-992eab5da68a', 'volume_size': 1} Aug 13 09:37:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Flow 'volume_create_manager' (bf54d6a0-8035-4607-ab07-37067355d310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896a1cc1-7b97-4aa6-b049-ece5483136eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896a1cc1-7b97-4aa6-b049-ece5483136eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1894734686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3035e4e8-6a2c-4271-b7d9-6c8a0a67541c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86f25c3a010411582d839acb7d76131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:37:43Z,use_quota=True,user_id='8ad6a7b7cdd04a29b7b9c266e16647c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7545463e-441e-469e-9c22-b2dc4ac329ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7545463e-441e-469e-9c22-b2dc4ac329ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1407c1-cc99-4e26-8d1b-9d3de76bb5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1407c1-cc99-4e26-8d1b-9d3de76bb5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3035e4e8-6a2c-4271-b7d9-6c8a0a67541c', 'volume_name': 'volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb07a51d-0cf9-404b-8205-3c04f2bbf80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb07a51d-0cf9-404b-8205-3c04f2bbf80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef18196-92de-4ae6-924c-54c846165741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:43 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Volume 3035e4e8-6a2c-4271-b7d9-6c8a0a67541c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c', 'volume_size': 1} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:43 devstack sudo[113141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:37:43 devstack sudo[113141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Flow 'volume_create_manager' (937d8522-a8be-4761-8773-bd8a8e7c7218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52dcd67-0692-42c9-92b3-472a529156a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52dcd67-0692-42c9-92b3-472a529156a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-662539415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e6351d-e1ef-481c-8090-da1e36d4836d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86f25c3a010411582d839acb7d76131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:37:43Z,use_quota=True,user_id='8ad6a7b7cdd04a29b7b9c266e16647c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7812dfb6-f881-4160-838b-79a6250f9168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7812dfb6-f881-4160-838b-79a6250f9168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9c7d62-0668-49c6-8a3d-994b22c2ad0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9c7d62-0668-49c6-8a3d-994b22c2ad0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e6351d-e1ef-481c-8090-da1e36d4836d', 'volume_name': 'volume-e8e6351d-e1ef-481c-8090-da1e36d4836d', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a1e1bb-3118-42de-83c0-8e87bfc26fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a1e1bb-3118-42de-83c0-8e87bfc26fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc12fdf6-10a5-4270-8201-b3924a08f4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:43 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Volume e8e6351d-e1ef-481c-8090-da1e36d4836d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e6351d-e1ef-481c-8090-da1e36d4836d', 'volume_size': 1} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:43 devstack sudo[113141]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.322s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:37:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:37:53 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=17,cinder:SELECT=27,cinder:INSERT=8,cinder:DELETE=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:37:53 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:37:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.551s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:37:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] Uploaded volume to glance image-id: d0ee48f2-0d2d-4726-bfad-d1ba8f874d34. {{(pid=94670) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 13 09:37:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.152s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:37:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1485988834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393e05fc-74be-4948-9f05-40df6f402a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86f25c3a010411582d839acb7d76131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:37:42Z,use_quota=True,user_id='8ad6a7b7cdd04a29b7b9c266e16647c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:37:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Creating volume 393e05fc-74be-4948-9f05-40df6f402a9b {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:37:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:37:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:37:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:37:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:37:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:37:57 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:37:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-393e05fc-74be-4948-9f05-40df6f402a9b 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:58 devstack sudo[113147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-393e05fc-74be-4948-9f05-40df6f402a9b 1073741824 Aug 13 09:37:58 devstack sudo[113147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:58 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-7e54f8cf-4b28-41b0-912f-1ff980b48338 tempest-VolumesActionsTest-251533333 None] Copy volume to image completed successfully. Aug 13 09:37:58 devstack sudo[113147]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-393e05fc-74be-4948-9f05-40df6f402a9b 1073741824" returned: 0 in 0.454s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-393e05fc-74be-4948-9f05-40df6f402a9b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:58 devstack sudo[113153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-393e05fc-74be-4948-9f05-40df6f402a9b Aug 13 09:37:58 devstack sudo[113153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:58 devstack sudo[113153]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-393e05fc-74be-4948-9f05-40df6f402a9b" returned: 0 in 0.263s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.494s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1983246055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7cf917-fbf6-4181-96d7-d49b147a38a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86f25c3a010411582d839acb7d76131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:37:42Z,use_quota=True,user_id='8ad6a7b7cdd04a29b7b9c266e16647c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Creating volume 7a7cf917-fbf6-4181-96d7-d49b147a38a6 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:37:58 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:58 devstack sudo[113156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6 1073741824 Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3367dbdc-30f6-4673-a1cf-537a8aa26b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-393e05fc-74be-4948-9f05-40df6f402a9b', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:58 devstack sudo[113156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e401dc5-6d6c-41d8-a3a7-0559f2cc962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:58 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Volume volume-393e05fc-74be-4948-9f05-40df6f402a9b (393e05fc-74be-4948-9f05-40df6f402a9b): created successfully Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e401dc5-6d6c-41d8-a3a7-0559f2cc962b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Flow 'volume_create_manager' (e1bbed86-0084-4244-8507-e9540888fd94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:37:58 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b49a4ec2-1093-4f07-a495-2a5be81965a8 tempest-CreateVolumesFromImageTest-357252048 None] Created volume successfully. Aug 13 09:37:59 devstack sudo[113156]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6 1073741824" returned: 0 in 0.485s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:59 devstack sudo[113162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6 Aug 13 09:37:59 devstack sudo[113162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:59 devstack sudo[113162]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6" returned: 0 in 0.263s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.764s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1542029191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752fceb7-2638-469b-b3a9-992eab5da68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86f25c3a010411582d839acb7d76131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:37:42Z,use_quota=True,user_id='8ad6a7b7cdd04a29b7b9c266e16647c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Creating volume 752fceb7-2638-469b-b3a9-992eab5da68a {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:37:59 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-752fceb7-2638-469b-b3a9-992eab5da68a 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:37:59 devstack sudo[113165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-752fceb7-2638-469b-b3a9-992eab5da68a 1073741824 Aug 13 09:37:59 devstack sudo[113165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e7a7a5-9d4b-4ed1-9e7e-b40a63732d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6997218b-d695-40d6-b92c-af6f3b8b9575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:37:59 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Volume volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6 (7a7cf917-fbf6-4181-96d7-d49b147a38a6): created successfully Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6997218b-d695-40d6-b92c-af6f3b8b9575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Flow 'volume_create_manager' (f5120041-353a-4102-8f13-df2b72b937fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:37:59 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b069dbbd-08cd-49f4-977a-bee3ca8b6b26 tempest-CreateVolumesFromImageTest-357252048 None] Created volume successfully. Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:37:59 devstack sudo[113165]: pam_unix(sudo:session): session closed for user root Aug 13 09:37:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-752fceb7-2638-469b-b3a9-992eab5da68a 1073741824" returned: 0 in 0.441s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-752fceb7-2638-469b-b3a9-992eab5da68a {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:00 devstack sudo[113171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-752fceb7-2638-469b-b3a9-992eab5da68a Aug 13 09:38:00 devstack sudo[113171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:00 devstack sudo[113171]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-752fceb7-2638-469b-b3a9-992eab5da68a" returned: 0 in 0.248s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.139s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1894734686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3035e4e8-6a2c-4271-b7d9-6c8a0a67541c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86f25c3a010411582d839acb7d76131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:37:43Z,use_quota=True,user_id='8ad6a7b7cdd04a29b7b9c266e16647c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Creating volume 3035e4e8-6a2c-4271-b7d9-6c8a0a67541c {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:38:00 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1dcc7c7-fda7-496a-b20d-1a23b43c1a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-752fceb7-2638-469b-b3a9-992eab5da68a', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:00 devstack sudo[113174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c 1073741824 Aug 13 09:38:00 devstack sudo[113174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfb5242-0376-4107-adfd-d6d55742860f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:00 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Volume volume-752fceb7-2638-469b-b3a9-992eab5da68a (752fceb7-2638-469b-b3a9-992eab5da68a): created successfully Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfb5242-0376-4107-adfd-d6d55742860f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Flow 'volume_create_manager' (f239a161-8e5a-48ef-8eff-9a6f4d43a2f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:38:00 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-7cd8ef46-6302-4387-9392-fed6199d5658 tempest-CreateVolumesFromImageTest-357252048 None] Created volume successfully. Aug 13 09:38:00 devstack sudo[113174]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c 1073741824" returned: 0 in 0.440s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:00 devstack sudo[113180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c Aug 13 09:38:00 devstack sudo[113180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:00 devstack sudo[113180]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c" returned: 0 in 0.235s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.462s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-662539415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e6351d-e1ef-481c-8090-da1e36d4836d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86f25c3a010411582d839acb7d76131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:37:43Z,use_quota=True,user_id='8ad6a7b7cdd04a29b7b9c266e16647c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Creating volume e8e6351d-e1ef-481c-8090-da1e36d4836d {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:38:01 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e8e6351d-e1ef-481c-8090-da1e36d4836d 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef18196-92de-4ae6-924c-54c846165741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:01 devstack sudo[113183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e8e6351d-e1ef-481c-8090-da1e36d4836d 1073741824 Aug 13 09:38:01 devstack sudo[113183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df0ea96-1547-4f19-89fa-6ba71be37e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:01 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Volume volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c (3035e4e8-6a2c-4271-b7d9-6c8a0a67541c): created successfully Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df0ea96-1547-4f19-89fa-6ba71be37e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Flow 'volume_create_manager' (bf54d6a0-8035-4607-ab07-37067355d310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:38:01 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e2f9a32e-ed87-49cd-ba6e-0f403f718ae1 tempest-CreateVolumesFromImageTest-357252048 None] Created volume successfully. Aug 13 09:38:01 devstack sudo[113183]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e8e6351d-e1ef-481c-8090-da1e36d4836d 1073741824" returned: 0 in 0.410s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e8e6351d-e1ef-481c-8090-da1e36d4836d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:01 devstack sudo[113189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e8e6351d-e1ef-481c-8090-da1e36d4836d Aug 13 09:38:01 devstack sudo[113189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:01 devstack sudo[113189]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e8e6351d-e1ef-481c-8090-da1e36d4836d" returned: 0 in 0.250s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.034s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc12fdf6-10a5-4270-8201-b3924a08f4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e6351d-e1ef-481c-8090-da1e36d4836d', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f948041-f70c-4fc6-83d8-75f01823fa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7640e548-24a9-4d44-ac68-620518428329]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:01 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Volume volume-e8e6351d-e1ef-481c-8090-da1e36d4836d (e8e6351d-e1ef-481c-8090-da1e36d4836d): created successfully Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f948041-f70c-4fc6-83d8-75f01823fa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Flow 'volume_create_manager' (937d8522-a8be-4761-8773-bd8a8e7c7218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:38:01 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-95d2ea50-c798-4d68-83d6-9c302586bed1 tempest-CreateVolumesFromImageTest-357252048 None] Created volume successfully. Aug 13 09:38:01 devstack sudo[113192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc Aug 13 09:38:01 devstack sudo[113192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:02 devstack sudo[113192]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" returned: 0 in 0.365s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:02 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d4a7b0-cb89-43cc-af50-52bbd4890939]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:38:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:02 devstack sudo[113197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc Aug 13 09:38:02 devstack sudo[113197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:02 devstack sudo[113197]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" returned: 0 in 0.364s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.c35d06d4-8c70-4909-9b8f-29542a5494f4oo097bfr.img {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:02 devstack sudo[113202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.c35d06d4-8c70-4909-9b8f-29542a5494f4oo097bfr.img Aug 13 09:38:02 devstack sudo[113202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "cinder-e8e6351d-e1ef-481c-8090-da1e36d4836d-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-e8e6351d-e1ef-481c-8090-da1e36d4836d-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:03 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "cinder-quobyte-e8e6351d-e1ef-481c-8090-da1e36d4836d" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:03 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-quobyte-e8e6351d-e1ef-481c-8090-da1e36d4836d" acquired by "delete_volume" :: waited 0.043s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:03 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1389f6fa-834d-48c6-939c-3c57f2d39c91]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:38:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e8e6351d-e1ef-481c-8090-da1e36d4836d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:03 devstack sudo[113214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e8e6351d-e1ef-481c-8090-da1e36d4836d Aug 13 09:38:03 devstack sudo[113214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:04 devstack sudo[113214]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e8e6351d-e1ef-481c-8090-da1e36d4836d" returned: 0 in 1.158s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e8e6351d-e1ef-481c-8090-da1e36d4836d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:04 devstack sudo[113220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e8e6351d-e1ef-481c-8090-da1e36d4836d Aug 13 09:38:04 devstack sudo[113220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:04 devstack sudo[113220]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-e8e6351d-e1ef-481c-8090-da1e36d4836d" returned: 0 in 0.470s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-quobyte-e8e6351d-e1ef-481c-8090-da1e36d4836d" released by "delete_volume" :: held 1.727s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Created reservations ['7b0b5ae3-4b4f-454d-9ac5-d5312b599b0a', '3ff304c7-50ce-4245-9871-93cc1dcee96a', '016cacba-1a03-4303-a87d-3fef54fad5ae', '008c2ef0-5cb3-4a55-956c-12da05975321'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:05 devstack sudo[113223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:38:05 devstack sudo[113223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "cinder-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "cinder-quobyte-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-quobyte-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c" acquired by "delete_volume" :: waited 0.033s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e669c79-c6e8-4df4-aab4-138996274822]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:05 devstack sudo[113223]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.586s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:38:05 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Deleted volume successfully. Aug 13 09:38:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-0ee157f8-34ea-49a5-a930-b1f9af279652 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-e8e6351d-e1ef-481c-8090-da1e36d4836d-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:06 devstack sudo[113226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c Aug 13 09:38:06 devstack sudo[113226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:06 devstack sudo[113202]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.c35d06d4-8c70-4909-9b8f-29542a5494f4oo097bfr.img" returned: 0 in 4.334s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:06 devstack sudo[113226]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c" returned: 0 in 1.019s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:06 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b15717-b5ad-4972-8db4-3b9714b067d8]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:38:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:06 devstack sudo[113231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c Aug 13 09:38:06 devstack sudo[113231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:06 devstack sudo[113232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc Aug 13 09:38:06 devstack sudo[113232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:07 devstack sudo[113231]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c" returned: 0 in 0.269s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-quobyte-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c" released by "delete_volume" :: held 1.349s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Created reservations ['9676a930-1a39-42e1-83c7-12dc37fa3172', '03b71eb4-763f-451f-bf88-9b17ff69224b', '193b99ea-7232-4997-81ab-5e6359b52256', '53420fc6-4ddd-4da1-91ab-2fe5527803d7'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:07 devstack sudo[113238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:38:07 devstack sudo[113238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:07 devstack sudo[113232]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" returned: 0 in 0.588s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Image conversion details: src /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.c35d06d4-8c70-4909-9b8f-29542a5494f4oo097bfr.img {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:38:07 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Converted 1024.00 MB image at 236.22 MB/s Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] c35d06d4-8c70-4909-9b8f-29542a5494f4 was raw, converting to qcow2 {{(pid=94670) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3843a260-7bee-4705-893b-76de55385e4b]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.c35d06d4-8c70-4909-9b8f-29542a5494f4oo097bfr.img {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:07 devstack sudo[113238]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.255s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:38:07 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Deleted volume successfully. Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a2b0acb9-6881-4140-8802-0d57d9698187 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-3035e4e8-6a2c-4271-b7d9-6c8a0a67541c-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:07 devstack sudo[113243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.c35d06d4-8c70-4909-9b8f-29542a5494f4oo097bfr.img Aug 13 09:38:07 devstack sudo[113243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:07 devstack sudo[113243]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.c35d06d4-8c70-4909-9b8f-29542a5494f4oo097bfr.img" returned: 0 in 0.381s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.c35d06d4-8c70-4909-9b8f-29542a5494f4oo097bfr.img {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "cinder-752fceb7-2638-469b-b3a9-992eab5da68a-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-752fceb7-2638-469b-b3a9-992eab5da68a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "cinder-quobyte-752fceb7-2638-469b-b3a9-992eab5da68a" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-quobyte-752fceb7-2638-469b-b3a9-992eab5da68a" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b523be-f595-44cd-bf27-1e1251d10180]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:38:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-752fceb7-2638-469b-b3a9-992eab5da68a {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:07 devstack sudo[113247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.c35d06d4-8c70-4909-9b8f-29542a5494f4oo097bfr.img Aug 13 09:38:07 devstack sudo[113247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:08 devstack sudo[113248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-752fceb7-2638-469b-b3a9-992eab5da68a Aug 13 09:38:08 devstack sudo[113248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:08 devstack sudo[113247]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.c35d06d4-8c70-4909-9b8f-29542a5494f4oo097bfr.img" returned: 1 in 0.363s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.c35d06d4-8c70-4909-9b8f-29542a5494f4oo097bfr.img' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.c35d06d4-8c70-4909-9b8f-29542a5494f4oo097bfr.img /opt/stack/data/cinder/conversion/vol_upload_i2ijvvqj {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:08 devstack sudo[113254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.c35d06d4-8c70-4909-9b8f-29542a5494f4oo097bfr.img /opt/stack/data/cinder/conversion/vol_upload_i2ijvvqj Aug 13 09:38:08 devstack sudo[113254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:08 devstack sudo[113248]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-752fceb7-2638-469b-b3a9-992eab5da68a" returned: 0 in 0.413s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-752fceb7-2638-469b-b3a9-992eab5da68a {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:08 devstack sudo[113259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-752fceb7-2638-469b-b3a9-992eab5da68a Aug 13 09:38:08 devstack sudo[113259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:08 devstack sudo[113254]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.c35d06d4-8c70-4909-9b8f-29542a5494f4oo097bfr.img /opt/stack/data/cinder/conversion/vol_upload_i2ijvvqj" returned: 0 in 0.348s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Image conversion details: src /opt/stack/data/cinder/conversion/a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc.temp_image.c35d06d4-8c70-4909-9b8f-29542a5494f4oo097bfr.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_i2ijvvqj {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:38:08 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2997a7af-5e84-4e2f-b9ab-720e28c337dd]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i2ijvvqj {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:08 devstack sudo[113259]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-752fceb7-2638-469b-b3a9-992eab5da68a" returned: 0 in 0.258s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-quobyte-752fceb7-2638-469b-b3a9-992eab5da68a" released by "delete_volume" :: held 0.730s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:08 devstack sudo[113264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i2ijvvqj Aug 13 09:38:08 devstack sudo[113264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Created reservations ['0872f9a9-579a-4f92-adba-1708273c870a', '78bcaaec-c9ba-4b12-90ff-d9cc261826ff', '8e5aa5c8-a252-49fc-b9b3-4859f7bfd593', 'e17e9836-f283-49ee-b215-6e6bb068873c'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:08 devstack sudo[113267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:38:08 devstack sudo[113267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:08 devstack sudo[113264]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i2ijvvqj" returned: 0 in 0.348s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "cinder-7a7cf917-fbf6-4181-96d7-d49b147a38a6-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-7a7cf917-fbf6-4181-96d7-d49b147a38a6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:09 devstack sudo[113267]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.346s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:09 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:38:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "cinder-quobyte-7a7cf917-fbf6-4181-96d7-d49b147a38a6" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:09 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Deleted volume successfully. Aug 13 09:38:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-quobyte-7a7cf917-fbf6-4181-96d7-d49b147a38a6" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e6effa95-a6fe-479c-9e6e-45d46442139d tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-752fceb7-2638-469b-b3a9-992eab5da68a-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:09 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[550b9233-bf12-41c5-8667-0075645cc92f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:38:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:09 devstack sudo[113273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6 Aug 13 09:38:09 devstack sudo[113273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:09 devstack sudo[113273]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6" returned: 0 in 0.432s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:09 devstack sudo[113278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6 Aug 13 09:38:09 devstack sudo[113278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:09 devstack sudo[113278]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-7a7cf917-fbf6-4181-96d7-d49b147a38a6" returned: 0 in 0.287s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-quobyte-7a7cf917-fbf6-4181-96d7-d49b147a38a6" released by "delete_volume" :: held 0.775s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Created reservations ['5f350b95-a8e5-4b7b-9145-74571c9e1b83', '98224bed-e540-459d-86cc-5cdaf6844a37', 'bac49752-f2cb-4823-b7c2-3f8adbe5a5f3', '1a7067fc-5ccf-4568-b835-9340fe89f8cc'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:10 devstack sudo[113282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:38:10 devstack sudo[113282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "cinder-393e05fc-74be-4948-9f05-40df6f402a9b-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-393e05fc-74be-4948-9f05-40df6f402a9b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "cinder-quobyte-393e05fc-74be-4948-9f05-40df6f402a9b" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-quobyte-393e05fc-74be-4948-9f05-40df6f402a9b" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d7caaa-51f8-4ffe-ae5f-47278e7eccae]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-393e05fc-74be-4948-9f05-40df6f402a9b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:10 devstack sudo[113282]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.297s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:38:10 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Deleted volume successfully. Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7ea5d44a-b557-407b-a919-2c29de81d6d5 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-7a7cf917-fbf6-4181-96d7-d49b147a38a6-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:10 devstack sudo[113285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-393e05fc-74be-4948-9f05-40df6f402a9b Aug 13 09:38:10 devstack sudo[113285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.954s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Uploaded volume to glance image-id: c35d06d4-8c70-4909-9b8f-29542a5494f4. {{(pid=94670) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 13 09:38:10 devstack sudo[113285]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-393e05fc-74be-4948-9f05-40df6f402a9b" returned: 0 in 0.434s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-393e05fc-74be-4948-9f05-40df6f402a9b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:10 devstack sudo[113290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-393e05fc-74be-4948-9f05-40df6f402a9b Aug 13 09:38:10 devstack sudo[113290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:11 devstack sudo[113290]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-393e05fc-74be-4948-9f05-40df6f402a9b" returned: 0 in 0.260s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-quobyte-393e05fc-74be-4948-9f05-40df6f402a9b" released by "delete_volume" :: held 0.741s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:11 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-24ad134c-22bf-4c06-b11d-b10eece9db16 tempest-VolumesActionsTest-251533333 None] Copy volume to image completed successfully. Aug 13 09:38:11 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Created reservations ['490f1797-48a0-4679-9b23-0309699bcebf', 'e3e25b6f-5e4e-4b19-a74f-0bbeab670b0d', '30603b80-62f4-49a8-8af3-220d8727db4a', '37f67323-e1fd-4a48-9986-f9671cbc856d'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:38:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:11 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:38:11 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:38:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:11 devstack sudo[113293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:38:11 devstack sudo[113293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:11 devstack sudo[113293]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.259s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:11 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:38:11 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Deleted volume successfully. Aug 13 09:38:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-43cab85f-6182-41f8-a00a-affa4c3971b4 tempest-CreateVolumesFromImageTest-357252048 None] Lock "cinder-393e05fc-74be-4948-9f05-40df6f402a9b-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Acquiring lock "cinder-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Lock "cinder-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Acquiring lock "cinder-quobyte-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Lock "cinder-quobyte-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" acquired by "delete_volume" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e2c694-744f-4ee4-b9f0-71bb3a126211]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:13 devstack sudo[113296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc Aug 13 09:38:13 devstack sudo[113296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:13 devstack sudo[113296]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" returned: 0 in 0.354s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:13 devstack sudo[113301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc Aug 13 09:38:13 devstack sudo[113301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:13 devstack sudo[113301]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" returned: 0 in 0.235s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Lock "cinder-quobyte-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc" released by "delete_volume" :: held 0.625s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Created reservations ['d01ca816-16e6-428f-99de-ab032660a3ab', 'd901b522-4d49-4d5d-a5c0-93677a03e772', 'cfe78308-f145-4da5-a4f2-9dee1db4241f', '3503788e-3117-493f-ad24-9a5a11c61db7'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:13 devstack sudo[113304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:38:13 devstack sudo[113304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:13 devstack sudo[113304]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.239s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:13 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:38:13 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Deleted volume successfully. Aug 13 09:38:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1a50ecfe-c055-48f1-9575-bc25777d675c tempest-VolumesActionsTest-251533333 None] Lock "cinder-a4d16ee6-93e7-4246-a7ca-0bc4d5936dfc-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Flow 'volume_create_manager' (2342c029-0d25-4733-b9e3-9967710f3438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8039cc0-89bd-42fa-966b-4f8097cfd15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8039cc0-89bd-42fa-966b-4f8097cfd15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1355121419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13e1f26-1dc5-4b3c-8426-11379c25a665,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cae9c6431d774afba483598f7f96a15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:38:23Z,use_quota=True,user_id='3ce89bf1077b411ba3c434f76d0bcbfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0ddc8e-03cb-44c3-809d-0008ecfcb640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0ddc8e-03cb-44c3-809d-0008ecfcb640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d37a18-e212-4d9a-abce-c8e720dbce7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d37a18-e212-4d9a-abce-c8e720dbce7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a13e1f26-1dc5-4b3c-8426-11379c25a665', 'volume_name': 'volume-a13e1f26-1dc5-4b3c-8426-11379c25a665', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb051d9-e496-473e-8882-087a34117cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb051d9-e496-473e-8882-087a34117cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8361116e-02d5-447e-9b93-72c301f8af4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:22 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Volume a13e1f26-1dc5-4b3c-8426-11379c25a665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a13e1f26-1dc5-4b3c-8426-11379c25a665', 'volume_size': 1} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1355121419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13e1f26-1dc5-4b3c-8426-11379c25a665,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cae9c6431d774afba483598f7f96a15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:38:23Z,use_quota=True,user_id='3ce89bf1077b411ba3c434f76d0bcbfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Creating volume a13e1f26-1dc5-4b3c-8426-11379c25a665 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:38:22 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:38:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a13e1f26-1dc5-4b3c-8426-11379c25a665 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:22 devstack sudo[113311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a13e1f26-1dc5-4b3c-8426-11379c25a665 1073741824 Aug 13 09:38:22 devstack sudo[113311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:23 devstack sudo[113311]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a13e1f26-1dc5-4b3c-8426-11379c25a665 1073741824" returned: 0 in 0.417s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a13e1f26-1dc5-4b3c-8426-11379c25a665 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:23 devstack sudo[113318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a13e1f26-1dc5-4b3c-8426-11379c25a665 Aug 13 09:38:23 devstack sudo[113318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:23 devstack sudo[113318]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a13e1f26-1dc5-4b3c-8426-11379c25a665" returned: 0 in 0.253s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:38:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8361116e-02d5-447e-9b93-72c301f8af4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a13e1f26-1dc5-4b3c-8426-11379c25a665', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720c69f9-2876-4859-92f7-13fe5a08e7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:23 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Volume volume-a13e1f26-1dc5-4b3c-8426-11379c25a665 (a13e1f26-1dc5-4b3c-8426-11379c25a665): created successfully Aug 13 09:38:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720c69f9-2876-4859-92f7-13fe5a08e7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Flow 'volume_create_manager' (2342c029-0d25-4733-b9e3-9967710f3438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:38:23 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-4292ec01-777d-42e5-b3b8-d8f35efe9a2b tempest-VolumesListTestJSON-517300364 None] Created volume successfully. Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Flow 'volume_create_manager' (7f120411-59fa-49ba-a156-d0e4c9a9b7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffb0aa7-bf62-4a9b-9f4b-4325026f1322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffb0aa7-bf62-4a9b-9f4b-4325026f1322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-119712291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0749651-b5ed-4205-bebe-54afecf68393,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cae9c6431d774afba483598f7f96a15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:38:24Z,use_quota=True,user_id='3ce89bf1077b411ba3c434f76d0bcbfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71381a4b-8a80-4893-9d52-58c27b3037de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71381a4b-8a80-4893-9d52-58c27b3037de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bbd1a3-4635-4eaf-8179-ff9486f11222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bbd1a3-4635-4eaf-8179-ff9486f11222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0749651-b5ed-4205-bebe-54afecf68393', 'volume_name': 'volume-a0749651-b5ed-4205-bebe-54afecf68393', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f0d7a3-f6f3-4a24-8163-c84092d46619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f0d7a3-f6f3-4a24-8163-c84092d46619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3209510-0d1f-4267-b260-d153634212d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:24 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Volume a0749651-b5ed-4205-bebe-54afecf68393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0749651-b5ed-4205-bebe-54afecf68393', 'volume_size': 1} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-119712291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0749651-b5ed-4205-bebe-54afecf68393,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cae9c6431d774afba483598f7f96a15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:38:24Z,use_quota=True,user_id='3ce89bf1077b411ba3c434f76d0bcbfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Creating volume a0749651-b5ed-4205-bebe-54afecf68393 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:38:24 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a0749651-b5ed-4205-bebe-54afecf68393 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:24 devstack sudo[113321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a0749651-b5ed-4205-bebe-54afecf68393 1073741824 Aug 13 09:38:24 devstack sudo[113321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:24 devstack sudo[113321]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a0749651-b5ed-4205-bebe-54afecf68393 1073741824" returned: 0 in 0.419s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a0749651-b5ed-4205-bebe-54afecf68393 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:24 devstack sudo[113327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a0749651-b5ed-4205-bebe-54afecf68393 Aug 13 09:38:24 devstack sudo[113327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:24 devstack sudo[113327]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a0749651-b5ed-4205-bebe-54afecf68393" returned: 0 in 0.233s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3209510-0d1f-4267-b260-d153634212d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0749651-b5ed-4205-bebe-54afecf68393', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f707a1-0b14-4eaa-953d-005ce92a78fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:25 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Volume volume-a0749651-b5ed-4205-bebe-54afecf68393 (a0749651-b5ed-4205-bebe-54afecf68393): created successfully Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f707a1-0b14-4eaa-953d-005ce92a78fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Flow 'volume_create_manager' (7f120411-59fa-49ba-a156-d0e4c9a9b7c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:38:25 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-dd206660-7ce1-4816-b713-d7b21c52216b tempest-VolumesListTestJSON-517300364 None] Created volume successfully. Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Flow 'volume_create_manager' (9ddabccc-5d8b-423f-a350-78fb794794b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a127e6ee-2dbc-4ac4-a734-4bbd8330c774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a127e6ee-2dbc-4ac4-a734-4bbd8330c774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-860782211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c34dc6-f94c-4069-bb2a-4e29195522d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cae9c6431d774afba483598f7f96a15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:38:26Z,use_quota=True,user_id='3ce89bf1077b411ba3c434f76d0bcbfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f98a4ae-09b5-4b6d-aaf9-6736ffc98220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f98a4ae-09b5-4b6d-aaf9-6736ffc98220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f61d893-6ba5-4a13-9fbf-fdea7c03c756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f61d893-6ba5-4a13-9fbf-fdea7c03c756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2c34dc6-f94c-4069-bb2a-4e29195522d2', 'volume_name': 'volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca286b67-82d4-45f3-a97b-3b1c89899d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca286b67-82d4-45f3-a97b-3b1c89899d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60d1f0f-ff9b-46ad-baa0-b9e2f9a9a825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:25 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Volume d2c34dc6-f94c-4069-bb2a-4e29195522d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2', 'volume_size': 1} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-860782211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c34dc6-f94c-4069-bb2a-4e29195522d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cae9c6431d774afba483598f7f96a15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:38:26Z,use_quota=True,user_id='3ce89bf1077b411ba3c434f76d0bcbfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Creating volume d2c34dc6-f94c-4069-bb2a-4e29195522d2 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:38:25 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:38:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:25 devstack sudo[113330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2 1073741824 Aug 13 09:38:25 devstack sudo[113330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:26 devstack sudo[113330]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2 1073741824" returned: 0 in 0.402s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:26 devstack sudo[113335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2 Aug 13 09:38:26 devstack sudo[113335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:26 devstack sudo[113335]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2" returned: 0 in 0.242s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:38:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60d1f0f-ff9b-46ad-baa0-b9e2f9a9a825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60dbd1b0-f9c9-4e2b-b9b6-33110ef8a834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:38:26 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Volume volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2 (d2c34dc6-f94c-4069-bb2a-4e29195522d2): created successfully Aug 13 09:38:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60dbd1b0-f9c9-4e2b-b9b6-33110ef8a834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:38:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Flow 'volume_create_manager' (9ddabccc-5d8b-423f-a350-78fb794794b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:38:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-01f41996-4ec0-402b-a6ea-c07690924ecf tempest-VolumesListTestJSON-517300364 None] Created volume successfully. Aug 13 09:38:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Acquiring lock "cinder-d2c34dc6-f94c-4069-bb2a-4e29195522d2-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Lock "cinder-d2c34dc6-f94c-4069-bb2a-4e29195522d2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Acquiring lock "cinder-quobyte-d2c34dc6-f94c-4069-bb2a-4e29195522d2" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Lock "cinder-quobyte-d2c34dc6-f94c-4069-bb2a-4e29195522d2" acquired by "delete_volume" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:28 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab1e6eb-219c-4527-ad60-a5df08523a78]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:38:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:28 devstack sudo[113338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2 Aug 13 09:38:28 devstack sudo[113338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:29 devstack sudo[113338]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2" returned: 0 in 0.351s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:29 devstack sudo[113343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2 Aug 13 09:38:29 devstack sudo[113343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:29 devstack sudo[113343]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d2c34dc6-f94c-4069-bb2a-4e29195522d2" returned: 0 in 0.240s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Lock "cinder-quobyte-d2c34dc6-f94c-4069-bb2a-4e29195522d2" released by "delete_volume" :: held 0.631s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Created reservations ['df085c36-9cd0-4ac4-9b7c-fe3114d84e92', '88581079-e0a6-4582-834d-8921f2046cc5', 'bc78e896-ac04-4626-b5f0-ff9f765df9ae', '5f4151e4-4104-47c7-8f5c-b567f1eaf8c7'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:29 devstack sudo[113346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:38:29 devstack sudo[113346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:29 devstack sudo[113346]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.246s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:38:29 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Deleted volume successfully. Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5990296b-b893-43b8-b097-e8d88974807f tempest-VolumesListTestJSON-517300364 None] Lock "cinder-d2c34dc6-f94c-4069-bb2a-4e29195522d2-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Acquiring lock "cinder-a0749651-b5ed-4205-bebe-54afecf68393-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Lock "cinder-a0749651-b5ed-4205-bebe-54afecf68393-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Acquiring lock "cinder-quobyte-a0749651-b5ed-4205-bebe-54afecf68393" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Lock "cinder-quobyte-a0749651-b5ed-4205-bebe-54afecf68393" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[73607302-a206-430c-b85c-b3ede579083f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:38:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a0749651-b5ed-4205-bebe-54afecf68393 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:30 devstack sudo[113349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a0749651-b5ed-4205-bebe-54afecf68393 Aug 13 09:38:30 devstack sudo[113349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:30 devstack sudo[113349]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a0749651-b5ed-4205-bebe-54afecf68393" returned: 0 in 0.342s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a0749651-b5ed-4205-bebe-54afecf68393 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:30 devstack sudo[113355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a0749651-b5ed-4205-bebe-54afecf68393 Aug 13 09:38:30 devstack sudo[113355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:30 devstack sudo[113355]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a0749651-b5ed-4205-bebe-54afecf68393" returned: 0 in 0.242s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Lock "cinder-quobyte-a0749651-b5ed-4205-bebe-54afecf68393" released by "delete_volume" :: held 0.620s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:30 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Created reservations ['58b3bf08-dfdc-4201-a9ee-ea2dc286422e', 'f18965ce-b150-4ffa-9bab-8a6691a27764', 'fdc0ffed-35bf-40da-850f-8fe2409c7f76', 'e40bb500-8937-4b7c-a9f4-8756d39b9d7e'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:38:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:38:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:38:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:30 devstack sudo[113358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:38:30 devstack sudo[113358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:30 devstack sudo[113358]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.244s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:30 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:38:30 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Deleted volume successfully. Aug 13 09:38:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c241c44a-5020-4a06-989b-b28d9f5638f3 tempest-VolumesListTestJSON-517300364 None] Lock "cinder-a0749651-b5ed-4205-bebe-54afecf68393-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Acquiring lock "cinder-a13e1f26-1dc5-4b3c-8426-11379c25a665-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Lock "cinder-a13e1f26-1dc5-4b3c-8426-11379c25a665-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Acquiring lock "cinder-quobyte-a13e1f26-1dc5-4b3c-8426-11379c25a665" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Lock "cinder-quobyte-a13e1f26-1dc5-4b3c-8426-11379c25a665" acquired by "delete_volume" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[719d398a-0ad4-4eb7-849f-78ca5dd20ba4]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a13e1f26-1dc5-4b3c-8426-11379c25a665 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:31 devstack sudo[113361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a13e1f26-1dc5-4b3c-8426-11379c25a665 Aug 13 09:38:31 devstack sudo[113361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:31 devstack sudo[113361]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a13e1f26-1dc5-4b3c-8426-11379c25a665" returned: 0 in 0.366s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a13e1f26-1dc5-4b3c-8426-11379c25a665 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:31 devstack sudo[113400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a13e1f26-1dc5-4b3c-8426-11379c25a665 Aug 13 09:38:31 devstack sudo[113400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:31 devstack sudo[113400]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a13e1f26-1dc5-4b3c-8426-11379c25a665" returned: 0 in 0.248s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Lock "cinder-quobyte-a13e1f26-1dc5-4b3c-8426-11379c25a665" released by "delete_volume" :: held 0.656s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Created reservations ['ed5ac9dd-6e61-46ed-b396-8b5f1c0a051c', 'd4a6a439-243f-4af5-92cf-f8c2b18fb997', '8cc8ff15-9826-4ab2-815c-2dd79e74d05f', 'e387aae0-25f7-4e93-a9f8-dff14fb78e19'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:31 devstack sudo[113405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:38:31 devstack sudo[113405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:32 devstack sudo[113405]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.245s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:32 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:38:32 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Deleted volume successfully. Aug 13 09:38:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-326cbff5-3a80-43e5-99eb-17416b6409c8 tempest-VolumesListTestJSON-517300364 None] Lock "cinder-a13e1f26-1dc5-4b3c-8426-11379c25a665-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:38:41 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=61,cinder:UPDATE=96,cinder:INSERT=21,cinder:DELETE=7 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:38:42 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=56,cinder:UPDATE=93,cinder:DELETE=10,cinder:INSERT=23 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:38:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:38:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:38:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:38:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:38:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:38:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:38:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:38:43 devstack sudo[113416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:38:43 devstack sudo[113416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:38:43 devstack sudo[113416]: pam_unix(sudo:session): session closed for user root Aug 13 09:38:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.325s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:38:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:38:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:38:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:38:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:38:53 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:38:53 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Flow 'volume_create_manager' (9cc9dbd7-4b69-46c3-9a8c-36b82e970726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01f46b0-4244-4173-b572-3b8cd64930d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01f46b0-4244-4173-b572-3b8cd64930d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-140318095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db80a1dd-decc-454e-9e09-2a0603a0f88b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a84f71f6a3a54a0f8f27a5dd263ebfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:39:05Z,use_quota=True,user_id='1bf087757744484b9c7cdfc91e9b2656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b9c71f-ae53-4d18-a7dd-0ec64e152abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b9c71f-ae53-4d18-a7dd-0ec64e152abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2715edb8-ad5e-4fe6-b453-49c26feabb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2715edb8-ad5e-4fe6-b453-49c26feabb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db80a1dd-decc-454e-9e09-2a0603a0f88b', 'volume_name': 'volume-db80a1dd-decc-454e-9e09-2a0603a0f88b', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78628a22-a545-493e-b107-4d073e9eefbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78628a22-a545-493e-b107-4d073e9eefbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351bba8b-68e0-4c80-a76e-2992949011b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:39:05 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Volume db80a1dd-decc-454e-9e09-2a0603a0f88b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db80a1dd-decc-454e-9e09-2a0603a0f88b', 'volume_size': 1} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-140318095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db80a1dd-decc-454e-9e09-2a0603a0f88b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a84f71f6a3a54a0f8f27a5dd263ebfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:39:05Z,use_quota=True,user_id='1bf087757744484b9c7cdfc91e9b2656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Creating volume db80a1dd-decc-454e-9e09-2a0603a0f88b {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:39:05 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-db80a1dd-decc-454e-9e09-2a0603a0f88b 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:39:05 devstack sudo[113539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-db80a1dd-decc-454e-9e09-2a0603a0f88b 1073741824 Aug 13 09:39:05 devstack sudo[113539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:39:05 devstack sudo[113539]: pam_unix(sudo:session): session closed for user root Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-db80a1dd-decc-454e-9e09-2a0603a0f88b 1073741824" returned: 0 in 0.416s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:39:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-db80a1dd-decc-454e-9e09-2a0603a0f88b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:39:05 devstack sudo[113544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-db80a1dd-decc-454e-9e09-2a0603a0f88b Aug 13 09:39:05 devstack sudo[113544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:39:06 devstack sudo[113544]: pam_unix(sudo:session): session closed for user root Aug 13 09:39:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-db80a1dd-decc-454e-9e09-2a0603a0f88b" returned: 0 in 0.235s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:39:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:39:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:39:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351bba8b-68e0-4c80-a76e-2992949011b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db80a1dd-decc-454e-9e09-2a0603a0f88b', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:39:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca482d40-6255-48a1-8ac9-64861a86397e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:39:06 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Volume volume-db80a1dd-decc-454e-9e09-2a0603a0f88b (db80a1dd-decc-454e-9e09-2a0603a0f88b): created successfully Aug 13 09:39:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca482d40-6255-48a1-8ac9-64861a86397e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:39:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Flow 'volume_create_manager' (9cc9dbd7-4b69-46c3-9a8c-36b82e970726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:39:06 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-03dd50eb-0872-4d47-acc6-10b0fea284b4 tempest-TestMinimumBasicScenario-1752168305 None] Created volume successfully. Aug 13 09:39:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-887cfaa3-54bd-4510-b493-2de864104b81 req-9a80e0f0-1456-48e7-b8c9-931403907b90 tempest-TestMinimumBasicScenario-1752168305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:39:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-887cfaa3-54bd-4510-b493-2de864104b81 req-9a80e0f0-1456-48e7-b8c9-931403907b90 tempest-TestMinimumBasicScenario-1752168305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:39:07 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f27c745-8aa6-40a2-be5b-c73f8dceb168]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:39:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-887cfaa3-54bd-4510-b493-2de864104b81 req-9a80e0f0-1456-48e7-b8c9-931403907b90 tempest-TestMinimumBasicScenario-1752168305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-db80a1dd-decc-454e-9e09-2a0603a0f88b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:39:07 devstack sudo[113559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-db80a1dd-decc-454e-9e09-2a0603a0f88b Aug 13 09:39:07 devstack sudo[113559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:39:07 devstack sudo[113559]: pam_unix(sudo:session): session closed for user root Aug 13 09:39:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [req-887cfaa3-54bd-4510-b493-2de864104b81 req-9a80e0f0-1456-48e7-b8c9-931403907b90 tempest-TestMinimumBasicScenario-1752168305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-db80a1dd-decc-454e-9e09-2a0603a0f88b" returned: 0 in 0.389s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:39:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [req-887cfaa3-54bd-4510-b493-2de864104b81 req-9a80e0f0-1456-48e7-b8c9-931403907b90 tempest-TestMinimumBasicScenario-1752168305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.407s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:39:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-887cfaa3-54bd-4510-b493-2de864104b81 req-9a80e0f0-1456-48e7-b8c9-931403907b90 tempest-TestMinimumBasicScenario-1752168305 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4', 'name': 'volume-db80a1dd-decc-454e-9e09-2a0603a0f88b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45fb3a90-0899-45e7-8631-2e3ca9ea19d2', 'enforce_multipath': True} {{(pid=94670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 13 09:39:07 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-887cfaa3-54bd-4510-b493-2de864104b81 req-9a80e0f0-1456-48e7-b8c9-931403907b90 tempest-TestMinimumBasicScenario-1752168305 None] attachment_update completed successfully. Aug 13 09:39:17 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:39:17 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=6,cinder:SELECT=8,cinder:DELETE=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:39:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:39:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:39:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:39:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:39:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:39:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:39:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:39:43 devstack sudo[114101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:39:43 devstack sudo[114101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:39:43 devstack sudo[114101]: pam_unix(sudo:session): session closed for user root Aug 13 09:39:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.295s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:39:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:39:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:39:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:39:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:39:57 devstack cinder-volume[94670]: INFO cinder.volume.manager [req-010fc513-7853-4709-8d18-a19d5d1b1ae2 req-16a6e6bd-af8c-434a-9b81-4fc6b264608e tempest-TestMinimumBasicScenario-1752168305 None] Terminate volume connection completed successfully. Aug 13 09:39:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [req-010fc513-7853-4709-8d18-a19d5d1b1ae2 req-16a6e6bd-af8c-434a-9b81-4fc6b264608e tempest-TestMinimumBasicScenario-1752168305 None] Deleting attachment 45fb3a90-0899-45e7-8631-2e3ca9ea19d2. {{(pid=94670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 13 09:39:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Acquiring lock "cinder-db80a1dd-decc-454e-9e09-2a0603a0f88b-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:39:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Lock "cinder-db80a1dd-decc-454e-9e09-2a0603a0f88b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:39:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Acquiring lock "cinder-quobyte-db80a1dd-decc-454e-9e09-2a0603a0f88b" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:39:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Lock "cinder-quobyte-db80a1dd-decc-454e-9e09-2a0603a0f88b" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:39:57 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0535c43d-3b38-4f6b-9b52-c5e00f14ee60]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:39:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-db80a1dd-decc-454e-9e09-2a0603a0f88b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:39:57 devstack sudo[114130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-db80a1dd-decc-454e-9e09-2a0603a0f88b Aug 13 09:39:57 devstack sudo[114130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:39:58 devstack sudo[114130]: pam_unix(sudo:session): session closed for user root Aug 13 09:39:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-db80a1dd-decc-454e-9e09-2a0603a0f88b" returned: 0 in 0.362s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:39:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-db80a1dd-decc-454e-9e09-2a0603a0f88b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:39:58 devstack sudo[114135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-db80a1dd-decc-454e-9e09-2a0603a0f88b Aug 13 09:39:58 devstack sudo[114135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:39:58 devstack sudo[114135]: pam_unix(sudo:session): session closed for user root Aug 13 09:39:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-db80a1dd-decc-454e-9e09-2a0603a0f88b" returned: 0 in 0.238s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:39:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Lock "cinder-quobyte-db80a1dd-decc-454e-9e09-2a0603a0f88b" released by "delete_volume" :: held 0.639s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:39:58 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Created reservations ['0cce9414-6a4b-45d4-b0f9-d0bfdf21ada5', '197d19f2-19ec-434d-b15f-18607dc7e5e4', '101b14c4-cf0b-4c1a-80bf-f86d6348a5eb', '0ec74487-e902-4ec5-a5a1-43a27e8f7067'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:39:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:39:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:39:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:39:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:39:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:39:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:39:58 devstack sudo[114138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:39:58 devstack sudo[114138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:39:58 devstack sudo[114138]: pam_unix(sudo:session): session closed for user root Aug 13 09:39:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.245s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:39:58 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:39:58 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Deleted volume successfully. Aug 13 09:39:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4ca6d381-e6f6-435c-9228-3035605ec8d2 tempest-TestMinimumBasicScenario-1752168305 None] Lock "cinder-db80a1dd-decc-454e-9e09-2a0603a0f88b-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:08 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:40:08 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Flow 'volume_create_manager' (3b332a81-4421-48dd-9793-9cb8af9ba956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d29bb1-d568-44a2-87c4-e9eccc2bd8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d29bb1-d568-44a2-87c4-e9eccc2bd8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2010499623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccfc14f1-3944-412b-98a4-cad16cefaa50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38163f93e2f3409899b86e71d705e240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:13Z,use_quota=True,user_id='083cec0cfcef4c469c002f0211022e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef2fe64-046b-44ef-a3af-001a36df9406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef2fe64-046b-44ef-a3af-001a36df9406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63113fa4-8841-4a4c-b683-681195a44903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63113fa4-8841-4a4c-b683-681195a44903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccfc14f1-3944-412b-98a4-cad16cefaa50', 'volume_name': 'volume-ccfc14f1-3944-412b-98a4-cad16cefaa50', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbcdd03f-2b10-4ccf-8286-8cab49bcddf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbcdd03f-2b10-4ccf-8286-8cab49bcddf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e99e048a-4360-47e2-9d8e-73cdcfab3508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:13 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume ccfc14f1-3944-412b-98a4-cad16cefaa50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccfc14f1-3944-412b-98a4-cad16cefaa50', 'volume_size': 1} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2010499623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccfc14f1-3944-412b-98a4-cad16cefaa50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38163f93e2f3409899b86e71d705e240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:13Z,use_quota=True,user_id='083cec0cfcef4c469c002f0211022e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Creating volume ccfc14f1-3944-412b-98a4-cad16cefaa50 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:40:13 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:13 devstack sudo[114173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 1073741824 Aug 13 09:40:13 devstack sudo[114173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:13 devstack sudo[114173]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 1073741824" returned: 0 in 0.402s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:13 devstack sudo[114179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 Aug 13 09:40:13 devstack sudo[114179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:13 devstack sudo[114179]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50" returned: 0 in 0.249s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e99e048a-4360-47e2-9d8e-73cdcfab3508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccfc14f1-3944-412b-98a4-cad16cefaa50', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3e8792-c136-4734-8266-afefdf6401a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:13 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 (ccfc14f1-3944-412b-98a4-cad16cefaa50): created successfully Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3e8792-c136-4734-8266-afefdf6401a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Flow 'volume_create_manager' (3b332a81-4421-48dd-9793-9cb8af9ba956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:13 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-4b787002-2d70-4832-b3d5-932eaed899f1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Created volume successfully. Aug 13 09:40:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] Creating offline snapshot 9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 of volume ccfc14f1-3944-412b-98a4-cad16cefaa50 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:40:14 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4ba336-0d44-47fb-b2a6-4651fc348510]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:14 devstack sudo[114182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 Aug 13 09:40:14 devstack sudo[114182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:14 devstack sudo[114182]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50" returned: 0 in 0.373s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:14 devstack sudo[114187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 1G Aug 13 09:40:14 devstack sudo[114187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:15 devstack sudo[114187]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 1G" returned: 0 in 0.387s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:15 devstack sudo[114192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 Aug 13 09:40:15 devstack sudo[114192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:15 devstack sudo[114192]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8" returned: 0 in 0.283s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:15 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 is being set with open permissions: ugo+rw Aug 13 09:40:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:15 devstack sudo[114197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 Aug 13 09:40:15 devstack sudo[114197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:15 devstack sudo[114197]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8" returned: 0 in 0.253s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:15 devstack sudo[114200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.info Aug 13 09:40:15 devstack sudo[114200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:15 devstack sudo[114200]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.info" returned: 0 in 0.245s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:15 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.info is being set with open permissions: ugo+rw Aug 13 09:40:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:15 devstack sudo[114203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.info Aug 13 09:40:15 devstack sudo[114203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:16 devstack sudo[114203]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.info" returned: 0 in 0.239s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:16 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-267d3894-180b-4765-9813-7d1f14eba9ea tempest-CreateVolumesFromSnapshotTest-42799330 None] Create snapshot completed successfully Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Flow 'volume_create_manager' (960fcd25-f5a3-486a-9423-9cf88ef1cd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd96f02e-f5c0-48b4-9a9e-a738aa9adfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd96f02e-f5c0-48b4-9a9e-a738aa9adfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-733042762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17dfc378-0f9f-4db0-b94e-35499545a494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38163f93e2f3409899b86e71d705e240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:17Z,use_quota=True,user_id='083cec0cfcef4c469c002f0211022e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8290c8aa-976a-4432-86f3-fd84b7b3c641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8290c8aa-976a-4432-86f3-fd84b7b3c641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72055426-6f29-48ae-8b03-d75155097f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72055426-6f29-48ae-8b03-d75155097f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17dfc378-0f9f-4db0-b94e-35499545a494', 'volume_name': 'volume-17dfc378-0f9f-4db0-b94e-35499545a494', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32387ac-2144-4b52-bb9a-b78de33df104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32387ac-2144-4b52-bb9a-b78de33df104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff21de9-c0d3-4b89-9a6b-c46e444a6691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:16 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume 17dfc378-0f9f-4db0-b94e-35499545a494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17dfc378-0f9f-4db0-b94e-35499545a494', 'volume_size': 1} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-733042762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17dfc378-0f9f-4db0-b94e-35499545a494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38163f93e2f3409899b86e71d705e240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:17Z,use_quota=True,user_id='083cec0cfcef4c469c002f0211022e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Creating volume 17dfc378-0f9f-4db0-b94e-35499545a494 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:40:16 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:40:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dfc378-0f9f-4db0-b94e-35499545a494 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:17 devstack sudo[114206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dfc378-0f9f-4db0-b94e-35499545a494 1073741824 Aug 13 09:40:17 devstack sudo[114206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Flow 'volume_create_manager' (ab54fbcc-f54a-4178-b94a-5448bf074436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d864d43-cb91-4058-968b-01805fa6f062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d864d43-cb91-4058-968b-01805fa6f062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-903860786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb94725e-78d5-49c0-8c9a-349a34eba67a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38163f93e2f3409899b86e71d705e240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:17Z,use_quota=True,user_id='083cec0cfcef4c469c002f0211022e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c73ce8a-d91d-405d-95ac-8565d684f8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c73ce8a-d91d-405d-95ac-8565d684f8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d869279c-eef5-4601-ad75-0b0a2faa4f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d869279c-eef5-4601-ad75-0b0a2faa4f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb94725e-78d5-49c0-8c9a-349a34eba67a', 'volume_name': 'volume-cb94725e-78d5-49c0-8c9a-349a34eba67a', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b7a091-5d2f-4fa7-9c94-207119891372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b7a091-5d2f-4fa7-9c94-207119891372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a50d2b-cff1-46e0-9694-f728928df044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:17 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume cb94725e-78d5-49c0-8c9a-349a34eba67a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb94725e-78d5-49c0-8c9a-349a34eba67a', 'volume_size': 1} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:17 devstack sudo[114206]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dfc378-0f9f-4db0-b94e-35499545a494 1073741824" returned: 0 in 0.528s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dfc378-0f9f-4db0-b94e-35499545a494 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:17 devstack sudo[114212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dfc378-0f9f-4db0-b94e-35499545a494 Aug 13 09:40:17 devstack sudo[114212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Flow 'volume_create_manager' (07498e73-227e-40cd-9dec-dbbdf930a671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c9c047-188b-493c-a3cb-2f3e688e3d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c9c047-188b-493c-a3cb-2f3e688e3d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1868632901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58469b9-e716-4a57-97a4-95bf0962306a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38163f93e2f3409899b86e71d705e240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:18Z,use_quota=True,user_id='083cec0cfcef4c469c002f0211022e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5723fae7-586a-4401-96c5-44891e3ec5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5723fae7-586a-4401-96c5-44891e3ec5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d9ff1c-0a4f-4ac4-b1f8-9a25fa837a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d9ff1c-0a4f-4ac4-b1f8-9a25fa837a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f58469b9-e716-4a57-97a4-95bf0962306a', 'volume_name': 'volume-f58469b9-e716-4a57-97a4-95bf0962306a', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43669233-e3ec-46e2-a93b-06e7e3a42e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43669233-e3ec-46e2-a93b-06e7e3a42e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0342c371-04b9-495d-8837-7cad2f9e9cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:17 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume f58469b9-e716-4a57-97a4-95bf0962306a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f58469b9-e716-4a57-97a4-95bf0962306a', 'volume_size': 1} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:17 devstack sudo[114212]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dfc378-0f9f-4db0-b94e-35499545a494" returned: 0 in 0.356s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.448s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-903860786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb94725e-78d5-49c0-8c9a-349a34eba67a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38163f93e2f3409899b86e71d705e240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:17Z,use_quota=True,user_id='083cec0cfcef4c469c002f0211022e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Creating volume cb94725e-78d5-49c0-8c9a-349a34eba67a {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:40:17 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb94725e-78d5-49c0-8c9a-349a34eba67a 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff21de9-c0d3-4b89-9a6b-c46e444a6691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17dfc378-0f9f-4db0-b94e-35499545a494', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:17 devstack sudo[114215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb94725e-78d5-49c0-8c9a-349a34eba67a 1073741824 Aug 13 09:40:17 devstack sudo[114215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a93f05-15f9-4073-af9f-25eb0c4161a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:17 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume volume-17dfc378-0f9f-4db0-b94e-35499545a494 (17dfc378-0f9f-4db0-b94e-35499545a494): created successfully Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a93f05-15f9-4073-af9f-25eb0c4161a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Flow 'volume_create_manager' (960fcd25-f5a3-486a-9423-9cf88ef1cd23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:18 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-4f8c3efd-adb8-4833-8a31-4d468dc1c688 tempest-CreateVolumesFromSnapshotTest-42799330 None] Created volume successfully. Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Flow 'volume_create_manager' (e191e432-8800-4e1a-b9d0-e3f49ad6bebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bbeea3a-fcba-4722-8c05-26dac20747e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bbeea3a-fcba-4722-8c05-26dac20747e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1722164757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9571ed-91a7-45e6-aa60-3445c294c182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38163f93e2f3409899b86e71d705e240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:18Z,use_quota=True,user_id='083cec0cfcef4c469c002f0211022e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a31cd9-cf22-4da4-81fc-58b43afd30f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a31cd9-cf22-4da4-81fc-58b43afd30f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b04f70-f59b-4f34-b6f5-50867d0018db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b04f70-f59b-4f34-b6f5-50867d0018db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb9571ed-91a7-45e6-aa60-3445c294c182', 'volume_name': 'volume-bb9571ed-91a7-45e6-aa60-3445c294c182', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb9df9c-1e17-4809-b795-d169a6e5e51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb9df9c-1e17-4809-b795-d169a6e5e51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0a5fed-5b4c-4d23-8ac8-fd910b06d14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:18 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume bb9571ed-91a7-45e6-aa60-3445c294c182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb9571ed-91a7-45e6-aa60-3445c294c182', 'volume_size': 1} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:18 devstack sudo[114215]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb94725e-78d5-49c0-8c9a-349a34eba67a 1073741824" returned: 0 in 0.543s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb94725e-78d5-49c0-8c9a-349a34eba67a {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:18 devstack sudo[114221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb94725e-78d5-49c0-8c9a-349a34eba67a Aug 13 09:40:18 devstack sudo[114221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Flow 'volume_create_manager' (f16a48b7-7769-46e7-9432-1dbd85bd38ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ee5f63-14a9-4cbc-84a9-8d749b09ba34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ee5f63-14a9-4cbc-84a9-8d749b09ba34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-432066113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9591cca4-578d-404c-8941-b40d3fc00f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38163f93e2f3409899b86e71d705e240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:19Z,use_quota=True,user_id='083cec0cfcef4c469c002f0211022e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247977a2-4328-4ad2-b5d6-e5e5ac2708a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247977a2-4328-4ad2-b5d6-e5e5ac2708a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4da615-ccc9-4597-9d74-4c141e9b296b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4da615-ccc9-4597-9d74-4c141e9b296b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9591cca4-578d-404c-8941-b40d3fc00f84', 'volume_name': 'volume-9591cca4-578d-404c-8941-b40d3fc00f84', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af1963d-a9d9-4b65-bb2a-a34b497822e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af1963d-a9d9-4b65-bb2a-a34b497822e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5db9af-f791-4200-a3bb-84cd5fb79b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:18 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume 9591cca4-578d-404c-8941-b40d3fc00f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9591cca4-578d-404c-8941-b40d3fc00f84', 'volume_size': 1} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:18 devstack sudo[114221]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb94725e-78d5-49c0-8c9a-349a34eba67a" returned: 0 in 0.254s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.918s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1868632901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58469b9-e716-4a57-97a4-95bf0962306a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38163f93e2f3409899b86e71d705e240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:18Z,use_quota=True,user_id='083cec0cfcef4c469c002f0211022e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Creating volume f58469b9-e716-4a57-97a4-95bf0962306a {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:40:18 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f58469b9-e716-4a57-97a4-95bf0962306a 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:18 devstack sudo[114224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f58469b9-e716-4a57-97a4-95bf0962306a 1073741824 Aug 13 09:40:18 devstack sudo[114224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a50d2b-cff1-46e0-9694-f728928df044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb94725e-78d5-49c0-8c9a-349a34eba67a', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07a38df-b8ef-4601-b607-630898b924ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:18 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume volume-cb94725e-78d5-49c0-8c9a-349a34eba67a (cb94725e-78d5-49c0-8c9a-349a34eba67a): created successfully Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07a38df-b8ef-4601-b607-630898b924ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Flow 'volume_create_manager' (ab54fbcc-f54a-4178-b94a-5448bf074436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:18 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-2c3e675a-3ffa-40e3-9385-069af68d5988 tempest-CreateVolumesFromSnapshotTest-42799330 None] Created volume successfully. Aug 13 09:40:19 devstack sudo[114224]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f58469b9-e716-4a57-97a4-95bf0962306a 1073741824" returned: 0 in 0.429s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f58469b9-e716-4a57-97a4-95bf0962306a {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:19 devstack sudo[114229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f58469b9-e716-4a57-97a4-95bf0962306a Aug 13 09:40:19 devstack sudo[114229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:19 devstack sudo[114229]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f58469b9-e716-4a57-97a4-95bf0962306a" returned: 0 in 0.258s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.237s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1722164757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9571ed-91a7-45e6-aa60-3445c294c182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38163f93e2f3409899b86e71d705e240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:18Z,use_quota=True,user_id='083cec0cfcef4c469c002f0211022e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Creating volume bb9571ed-91a7-45e6-aa60-3445c294c182 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:40:19 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bb9571ed-91a7-45e6-aa60-3445c294c182 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:19 devstack sudo[114232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bb9571ed-91a7-45e6-aa60-3445c294c182 1073741824 Aug 13 09:40:19 devstack sudo[114232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0342c371-04b9-495d-8837-7cad2f9e9cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f58469b9-e716-4a57-97a4-95bf0962306a', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293af0c2-19d6-4758-a988-86f9cc8aaabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:19 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume volume-f58469b9-e716-4a57-97a4-95bf0962306a (f58469b9-e716-4a57-97a4-95bf0962306a): created successfully Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293af0c2-19d6-4758-a988-86f9cc8aaabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Flow 'volume_create_manager' (07498e73-227e-40cd-9dec-dbbdf930a671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:19 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d6ff5335-1deb-4d89-a25b-c8ec14e371e4 tempest-CreateVolumesFromSnapshotTest-42799330 None] Created volume successfully. Aug 13 09:40:19 devstack sudo[114232]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bb9571ed-91a7-45e6-aa60-3445c294c182 1073741824" returned: 0 in 0.447s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bb9571ed-91a7-45e6-aa60-3445c294c182 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:20 devstack sudo[114237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bb9571ed-91a7-45e6-aa60-3445c294c182 Aug 13 09:40:20 devstack sudo[114237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:20 devstack sudo[114237]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bb9571ed-91a7-45e6-aa60-3445c294c182" returned: 0 in 0.251s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.537s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-432066113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9591cca4-578d-404c-8941-b40d3fc00f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38163f93e2f3409899b86e71d705e240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:19Z,use_quota=True,user_id='083cec0cfcef4c469c002f0211022e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Creating volume 9591cca4-578d-404c-8941-b40d3fc00f84 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:40:20 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9591cca4-578d-404c-8941-b40d3fc00f84 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0a5fed-5b4c-4d23-8ac8-fd910b06d14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb9571ed-91a7-45e6-aa60-3445c294c182', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:20 devstack sudo[114242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9591cca4-578d-404c-8941-b40d3fc00f84 1073741824 Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e997ea-74ad-48b2-91a3-b462e6ff8164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:20 devstack sudo[114242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:20 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume volume-bb9571ed-91a7-45e6-aa60-3445c294c182 (bb9571ed-91a7-45e6-aa60-3445c294c182): created successfully Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e997ea-74ad-48b2-91a3-b462e6ff8164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Flow 'volume_create_manager' (e191e432-8800-4e1a-b9d0-e3f49ad6bebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:20 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-87979c24-12d1-4e32-8f1f-562dc9f1bcb9 tempest-CreateVolumesFromSnapshotTest-42799330 None] Created volume successfully. Aug 13 09:40:20 devstack sudo[114242]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9591cca4-578d-404c-8941-b40d3fc00f84 1073741824" returned: 0 in 0.450s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9591cca4-578d-404c-8941-b40d3fc00f84 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:20 devstack sudo[114248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9591cca4-578d-404c-8941-b40d3fc00f84 Aug 13 09:40:20 devstack sudo[114248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:20 devstack sudo[114248]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9591cca4-578d-404c-8941-b40d3fc00f84" returned: 0 in 0.238s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5db9af-f791-4200-a3bb-84cd5fb79b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9591cca4-578d-404c-8941-b40d3fc00f84', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80b97f9-7f0e-4633-9bdb-12dde71845aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:21 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Volume volume-9591cca4-578d-404c-8941-b40d3fc00f84 (9591cca4-578d-404c-8941-b40d3fc00f84): created successfully Aug 13 09:40:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80b97f9-7f0e-4633-9bdb-12dde71845aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Flow 'volume_create_manager' (f16a48b7-7769-46e7-9432-1dbd85bd38ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:21 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c8bfb0e7-3eae-433f-b32e-9d338dabe2f0 tempest-CreateVolumesFromSnapshotTest-42799330 None] Created volume successfully. Aug 13 09:40:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "cinder-9591cca4-578d-404c-8941-b40d3fc00f84-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-9591cca4-578d-404c-8941-b40d3fc00f84-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "cinder-quobyte-9591cca4-578d-404c-8941-b40d3fc00f84" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-9591cca4-578d-404c-8941-b40d3fc00f84" acquired by "delete_volume" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cae056a-e136-4b5d-bef0-3896feea2561]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9591cca4-578d-404c-8941-b40d3fc00f84 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:22 devstack sudo[114251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9591cca4-578d-404c-8941-b40d3fc00f84 Aug 13 09:40:22 devstack sudo[114251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:22 devstack sudo[114251]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9591cca4-578d-404c-8941-b40d3fc00f84" returned: 0 in 0.355s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9591cca4-578d-404c-8941-b40d3fc00f84 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:22 devstack sudo[114256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9591cca4-578d-404c-8941-b40d3fc00f84 Aug 13 09:40:22 devstack sudo[114256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:22 devstack sudo[114256]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9591cca4-578d-404c-8941-b40d3fc00f84" returned: 0 in 0.245s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-9591cca4-578d-404c-8941-b40d3fc00f84" released by "delete_volume" :: held 0.640s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Created reservations ['b5ed2b5b-e2f6-4207-af07-3e20316501ef', 'e7e2cd60-6b4b-4fb3-b30d-dc9ad699c0c6', 'e45b0921-928b-4c3a-8d8b-708eb26cd0ca', '7996e2f1-3207-4d39-8b6b-fdcdc67bf5f1'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:22 devstack sudo[114260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:40:22 devstack sudo[114260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:23 devstack sudo[114260]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.253s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:23 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:40:23 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Deleted volume successfully. Aug 13 09:40:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cbb62a51-e764-4bcd-b622-e74bb2e7a9fa tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-9591cca4-578d-404c-8941-b40d3fc00f84-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "cinder-bb9571ed-91a7-45e6-aa60-3445c294c182-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-bb9571ed-91a7-45e6-aa60-3445c294c182-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "cinder-quobyte-bb9571ed-91a7-45e6-aa60-3445c294c182" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-bb9571ed-91a7-45e6-aa60-3445c294c182" acquired by "delete_volume" :: waited 0.023s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:23 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f41915e-0fd7-4328-8c0f-fbaa3234bd09]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bb9571ed-91a7-45e6-aa60-3445c294c182 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:23 devstack sudo[114264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bb9571ed-91a7-45e6-aa60-3445c294c182 Aug 13 09:40:23 devstack sudo[114264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:23 devstack sudo[114264]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bb9571ed-91a7-45e6-aa60-3445c294c182" returned: 0 in 0.378s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bb9571ed-91a7-45e6-aa60-3445c294c182 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:23 devstack sudo[114269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bb9571ed-91a7-45e6-aa60-3445c294c182 Aug 13 09:40:23 devstack sudo[114269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:23 devstack sudo[114269]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bb9571ed-91a7-45e6-aa60-3445c294c182" returned: 0 in 0.254s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-bb9571ed-91a7-45e6-aa60-3445c294c182" released by "delete_volume" :: held 0.673s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:23 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Created reservations ['1303e2e0-9229-42ce-b8c5-0a83ae7ef937', 'aacbb162-205e-448d-aba5-a58f794bf9f2', '73e3d4df-27b6-45c5-b715-545935e54b4f', '9f71201b-a30b-4eda-8655-bc322b6aeab7'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:24 devstack sudo[114272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:40:24 devstack sudo[114272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:24 devstack sudo[114272]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.251s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:40:24 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Deleted volume successfully. Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b01275bd-8a91-4a06-bbcd-946bdf053dae tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-bb9571ed-91a7-45e6-aa60-3445c294c182-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "cinder-f58469b9-e716-4a57-97a4-95bf0962306a-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-f58469b9-e716-4a57-97a4-95bf0962306a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "cinder-quobyte-f58469b9-e716-4a57-97a4-95bf0962306a" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-f58469b9-e716-4a57-97a4-95bf0962306a" acquired by "delete_volume" :: waited 0.014s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c49e22-208b-439a-add1-7644826a5f80]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f58469b9-e716-4a57-97a4-95bf0962306a {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:24 devstack sudo[114275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f58469b9-e716-4a57-97a4-95bf0962306a Aug 13 09:40:24 devstack sudo[114275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:24 devstack sudo[114275]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f58469b9-e716-4a57-97a4-95bf0962306a" returned: 0 in 0.352s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f58469b9-e716-4a57-97a4-95bf0962306a {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:24 devstack sudo[114280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f58469b9-e716-4a57-97a4-95bf0962306a Aug 13 09:40:24 devstack sudo[114280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:25 devstack sudo[114280]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-f58469b9-e716-4a57-97a4-95bf0962306a" returned: 0 in 0.270s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-f58469b9-e716-4a57-97a4-95bf0962306a" released by "delete_volume" :: held 0.660s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Created reservations ['2e15f4db-79f6-484b-bb28-0c6544c16dc4', '57fb145a-e723-4fed-a089-118ea935d9af', '2e830f6d-d72b-42c6-b882-a1b3dedada1d', 'e13c9fcb-10b9-4d8d-8da4-74f716b12c68'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:25 devstack sudo[114283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:40:25 devstack sudo[114283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:25 devstack sudo[114283]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.266s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:40:25 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Deleted volume successfully. Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c2427e28-9a76-40f8-aedf-ae8a215ff758 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-f58469b9-e716-4a57-97a4-95bf0962306a-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "cinder-cb94725e-78d5-49c0-8c9a-349a34eba67a-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-cb94725e-78d5-49c0-8c9a-349a34eba67a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "cinder-quobyte-cb94725e-78d5-49c0-8c9a-349a34eba67a" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-cb94725e-78d5-49c0-8c9a-349a34eba67a" acquired by "delete_volume" :: waited 0.014s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc84c8f-6281-4e81-8c6e-721b32d25c77]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb94725e-78d5-49c0-8c9a-349a34eba67a {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:25 devstack sudo[114286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb94725e-78d5-49c0-8c9a-349a34eba67a Aug 13 09:40:25 devstack sudo[114286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:25 devstack sudo[114286]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb94725e-78d5-49c0-8c9a-349a34eba67a" returned: 0 in 0.370s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb94725e-78d5-49c0-8c9a-349a34eba67a {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:25 devstack sudo[114291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb94725e-78d5-49c0-8c9a-349a34eba67a Aug 13 09:40:25 devstack sudo[114291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:26 devstack sudo[114291]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-cb94725e-78d5-49c0-8c9a-349a34eba67a" returned: 0 in 0.250s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-cb94725e-78d5-49c0-8c9a-349a34eba67a" released by "delete_volume" :: held 0.660s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Created reservations ['f8d8408e-ca8f-4ca1-b104-14406dace5b3', '59343228-0ba8-48c2-bb62-49b5e28ea97b', '6349b7bb-101c-4507-b61d-f2e669c6fa60', 'f5393851-e36a-4cc9-b689-c399a52b22ad'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:26 devstack sudo[114294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:40:26 devstack sudo[114294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:26 devstack sudo[114294]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.242s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:40:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Deleted volume successfully. Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5de2f60e-d88d-495d-afa0-c3a3d561302f tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-cb94725e-78d5-49c0-8c9a-349a34eba67a-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "cinder-17dfc378-0f9f-4db0-b94e-35499545a494-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-17dfc378-0f9f-4db0-b94e-35499545a494-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "cinder-quobyte-17dfc378-0f9f-4db0-b94e-35499545a494" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-17dfc378-0f9f-4db0-b94e-35499545a494" acquired by "delete_volume" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[feccd94e-7c05-416e-8460-7378db50c6da]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dfc378-0f9f-4db0-b94e-35499545a494 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:26 devstack sudo[114297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dfc378-0f9f-4db0-b94e-35499545a494 Aug 13 09:40:26 devstack sudo[114297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:27 devstack sudo[114297]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dfc378-0f9f-4db0-b94e-35499545a494" returned: 0 in 0.383s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dfc378-0f9f-4db0-b94e-35499545a494 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:27 devstack sudo[114302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dfc378-0f9f-4db0-b94e-35499545a494 Aug 13 09:40:27 devstack sudo[114302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:27 devstack sudo[114302]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dfc378-0f9f-4db0-b94e-35499545a494" returned: 0 in 0.246s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-17dfc378-0f9f-4db0-b94e-35499545a494" released by "delete_volume" :: held 0.672s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Created reservations ['5882337a-110e-4357-84da-3a83d919f4d6', 'a5bfe3be-dd09-4104-b1e8-1923ca3c6d63', 'b254772b-be22-4076-882f-3b1ee05676ed', '442b310c-1dab-4940-af55-cc356b4ce4c3'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:27 devstack sudo[114305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:40:27 devstack sudo[114305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "cinder-9a515a85-8bf1-4dbb-a72a-23b8645fa4b8-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-9a515a85-8bf1-4dbb-a72a-23b8645fa4b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "cinder-quobyte-ccfc14f1-3944-412b-98a4-cad16cefaa50" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-ccfc14f1-3944-412b-98a4-cad16cefaa50" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "cinder-quobyte-9a515a85-8bf1-4dbb-a72a-23b8645fa4b8" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-9a515a85-8bf1-4dbb-a72a-23b8645fa4b8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Deleting offline snapshot 9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 of volume ccfc14f1-3944-412b-98a4-cad16cefaa50 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] snapshot_file for this snap is: volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[198cecd9-9d65-484e-ab17-dcad620ea317]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:27 devstack sudo[114305]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.270s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:27 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:40:27 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Deleted volume successfully. Aug 13 09:40:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-858037b1-b23e-4e8d-8990-02d9c9745da1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-17dfc378-0f9f-4db0-b94e-35499545a494-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:28 devstack sudo[114310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 Aug 13 09:40:28 devstack sudo[114310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:28 devstack sudo[114310]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8" returned: 0 in 0.372s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:28 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccfc14f1-3944-412b-98a4-cad16cefaa50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:40:28 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fa0648-9eae-4f4e-8084-da9b15be791b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:28 devstack sudo[114315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 Aug 13 09:40:28 devstack sudo[114315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:28 devstack sudo[114315]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50" returned: 0 in 0.364s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:28 devstack sudo[114320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 Aug 13 09:40:28 devstack sudo[114320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:29 devstack sudo[114320]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8" returned: 0 in 0.349s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:29 devstack sudo[114325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8 Aug 13 09:40:29 devstack sudo[114325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:29 devstack sudo[114325]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50.9a515a85-8bf1-4dbb-a72a-23b8645fa4b8" returned: 0 in 0.281s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-9a515a85-8bf1-4dbb-a72a-23b8645fa4b8" released by "_delete_snapshot" :: held 1.472s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-ccfc14f1-3944-412b-98a4-cad16cefaa50" released by "delete_snapshot" :: held 1.493s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:29 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Created reservations ['a4e9608f-eca9-48e8-a0b4-5f786342a568', '4aa6e570-351c-4ba9-9aa3-79e6be392a32', 'cf1f8ae8-432d-4b4e-8463-fd6fa6996bef', '959f78a0-901f-4e5e-84d4-f0c9c06cce6e'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:40:29 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Delete snapshot completed successfully. Aug 13 09:40:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-1644187f-fae5-4498-a7e6-1fee692ecb88 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-9a515a85-8bf1-4dbb-a72a-23b8645fa4b8-delete_snapshot" released by "delete_snapshot" :: held 1.627s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "cinder-ccfc14f1-3944-412b-98a4-cad16cefaa50-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-ccfc14f1-3944-412b-98a4-cad16cefaa50-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "cinder-quobyte-ccfc14f1-3944-412b-98a4-cad16cefaa50" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-ccfc14f1-3944-412b-98a4-cad16cefaa50" acquired by "delete_volume" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:30 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a23cc24-5bd5-4903-b697-24959baf459f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:30 devstack sudo[114329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 Aug 13 09:40:30 devstack sudo[114329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:30 devstack sudo[114329]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50" returned: 0 in 0.419s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:30 devstack sudo[114334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50 Aug 13 09:40:30 devstack sudo[114334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:30 devstack sudo[114334]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ccfc14f1-3944-412b-98a4-cad16cefaa50" returned: 0 in 0.251s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-quobyte-ccfc14f1-3944-412b-98a4-cad16cefaa50" released by "delete_volume" :: held 0.741s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:30 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Created reservations ['aaa82bad-d8ba-4710-8984-5ff43fda3fb6', 'e8923c52-a118-42dd-83ff-8d44a69f6325', '234ba6ea-41b8-499f-905f-dbda552cb819', 'e4c45125-4a42-4214-917a-911b3e6180a1'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:40:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:31 devstack sudo[114337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:40:31 devstack sudo[114337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:31 devstack sudo[114337]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.306s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:31 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:40:31 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Deleted volume successfully. Aug 13 09:40:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-494c3b84-bd57-4a08-9956-e9b55b1a94d1 tempest-CreateVolumesFromSnapshotTest-42799330 None] Lock "cinder-ccfc14f1-3944-412b-98a4-cad16cefaa50-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Flow 'volume_create_manager' (4ba4744f-e5d5-4cc0-a312-1af94d7fc4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39330616-660b-4b57-a9bd-c6c1a438adb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39330616-660b-4b57-a9bd-c6c1a438adb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-959142044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50f1651-cd57-49ad-87aa-42f0a5707aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2baf8e86e147dfb83287a10be41043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:34Z,use_quota=True,user_id='cc2111f947884a89b294c8c528fd8dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8daa55-9348-474a-aff2-98ccb1a024d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8daa55-9348-474a-aff2-98ccb1a024d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f576a23-60f2-48ed-ad3e-e209cd4cec66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f576a23-60f2-48ed-ad3e-e209cd4cec66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a50f1651-cd57-49ad-87aa-42f0a5707aa1', 'volume_name': 'volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b628f8-65df-4722-9655-39ec0703e044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b628f8-65df-4722-9655-39ec0703e044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8384e3a4-4558-44f3-94c1-9ef5133d9376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:34 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume a50f1651-cd57-49ad-87aa-42f0a5707aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1', 'volume_size': 1} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-959142044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50f1651-cd57-49ad-87aa-42f0a5707aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2baf8e86e147dfb83287a10be41043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:34Z,use_quota=True,user_id='cc2111f947884a89b294c8c528fd8dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Creating volume a50f1651-cd57-49ad-87aa-42f0a5707aa1 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:40:34 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:40:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:34 devstack sudo[114376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1 1073741824 Aug 13 09:40:34 devstack sudo[114376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:35 devstack sudo[114376]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1 1073741824" returned: 0 in 0.478s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:35 devstack sudo[114381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1 Aug 13 09:40:35 devstack sudo[114381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:35 devstack sudo[114381]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1" returned: 0 in 0.260s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:40:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8384e3a4-4558-44f3-94c1-9ef5133d9376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb45013-3ddb-4a67-922d-87adbc858b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:35 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1 (a50f1651-cd57-49ad-87aa-42f0a5707aa1): created successfully Aug 13 09:40:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb45013-3ddb-4a67-922d-87adbc858b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Flow 'volume_create_manager' (4ba4744f-e5d5-4cc0-a312-1af94d7fc4a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:35 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-9edf2228-08d1-4416-a1bc-7400b9984165 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Created volume successfully. Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Flow 'volume_create_manager' (2ece4731-c9f4-4b35-a685-a8dd2f198c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdac1354-113a-406f-a29f-f80dd2a0d2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdac1354-113a-406f-a29f-f80dd2a0d2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1070420779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69912f7f-a0a0-4ae1-b26f-9cbab345ebbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2baf8e86e147dfb83287a10be41043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:37Z,use_quota=True,user_id='cc2111f947884a89b294c8c528fd8dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1133b356-4321-4209-b40c-2343b1dacde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1133b356-4321-4209-b40c-2343b1dacde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a1b752-f576-4faa-9d7c-10ded1d66895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a1b752-f576-4faa-9d7c-10ded1d66895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69912f7f-a0a0-4ae1-b26f-9cbab345ebbd', 'volume_name': 'volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47a1574-5953-415a-a79f-00da6fdd043b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47a1574-5953-415a-a79f-00da6fdd043b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655719e1-9eae-437f-8a62-96471be9a075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:37 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume 69912f7f-a0a0-4ae1-b26f-9cbab345ebbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd', 'volume_size': 1} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1070420779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69912f7f-a0a0-4ae1-b26f-9cbab345ebbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2baf8e86e147dfb83287a10be41043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:37Z,use_quota=True,user_id='cc2111f947884a89b294c8c528fd8dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Creating volume 69912f7f-a0a0-4ae1-b26f-9cbab345ebbd {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:40:37 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:37 devstack sudo[114384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd 1073741824 Aug 13 09:40:37 devstack sudo[114384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Flow 'volume_create_manager' (a4704408-eaf0-4e1a-9ed8-c100d2d5236f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a422aa3-7e67-416d-808b-66315a955e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a422aa3-7e67-416d-808b-66315a955e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-838187708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54466fd2-d512-49c8-b5d7-68e78b833366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2baf8e86e147dfb83287a10be41043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:37Z,use_quota=True,user_id='cc2111f947884a89b294c8c528fd8dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7a3865-d347-4c18-bacc-21d1ce216016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7a3865-d347-4c18-bacc-21d1ce216016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16d3a3d-68a2-4ee8-ac1d-c08caef32e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16d3a3d-68a2-4ee8-ac1d-c08caef32e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54466fd2-d512-49c8-b5d7-68e78b833366', 'volume_name': 'volume-54466fd2-d512-49c8-b5d7-68e78b833366', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5fa2a8-f494-4203-8340-0c560cbf1b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5fa2a8-f494-4203-8340-0c560cbf1b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abaa5401-a768-4421-8aad-ff15ad1fa1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:37 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume 54466fd2-d512-49c8-b5d7-68e78b833366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54466fd2-d512-49c8-b5d7-68e78b833366', 'volume_size': 1} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:37 devstack sudo[114384]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd 1073741824" returned: 0 in 0.547s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:37 devstack sudo[114390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd Aug 13 09:40:37 devstack sudo[114390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Flow 'volume_create_manager' (5a7aeb84-5932-41f0-9f21-ef8f9558ef9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d051bd-68b4-40d1-841f-6d0771dd6163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d051bd-68b4-40d1-841f-6d0771dd6163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1748513899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f38bfc-ddd2-46ba-a020-345d43c9b2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2baf8e86e147dfb83287a10be41043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:38Z,use_quota=True,user_id='cc2111f947884a89b294c8c528fd8dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c481e17a-965e-4fe2-8783-fc5a33e4342c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c481e17a-965e-4fe2-8783-fc5a33e4342c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b588526-273e-4b8c-a14e-4c6839a9cf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b588526-273e-4b8c-a14e-4c6839a9cf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f38bfc-ddd2-46ba-a020-345d43c9b2d6', 'volume_name': 'volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6145a070-348b-403d-815c-a59d4f650f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6145a070-348b-403d-815c-a59d4f650f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1eecae-64d1-4cee-a709-79ec646a9ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:37 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume 77f38bfc-ddd2-46ba-a020-345d43c9b2d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6', 'volume_size': 1} Aug 13 09:40:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:38 devstack sudo[114390]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd" returned: 0 in 0.322s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.542s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-838187708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54466fd2-d512-49c8-b5d7-68e78b833366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2baf8e86e147dfb83287a10be41043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:37Z,use_quota=True,user_id='cc2111f947884a89b294c8c528fd8dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Creating volume 54466fd2-d512-49c8-b5d7-68e78b833366 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:40:38 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-54466fd2-d512-49c8-b5d7-68e78b833366 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655719e1-9eae-437f-8a62-96471be9a075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af08b643-289d-4447-8afc-8ca3c01afc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:38 devstack sudo[114393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-54466fd2-d512-49c8-b5d7-68e78b833366 1073741824 Aug 13 09:40:38 devstack sudo[114393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:38 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd (69912f7f-a0a0-4ae1-b26f-9cbab345ebbd): created successfully Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af08b643-289d-4447-8afc-8ca3c01afc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Flow 'volume_create_manager' (2ece4731-c9f4-4b35-a685-a8dd2f198c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:38 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-32ee6d3f-419e-47af-b5a2-76d956aa4c76 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Created volume successfully. Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Flow 'volume_create_manager' (18e2eee5-b653-448e-a256-1364a380a683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffeed5cc-8d88-482a-962f-379d6d8f1555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffeed5cc-8d88-482a-962f-379d6d8f1555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-613313420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d115c4f9-9c24-460c-9d1a-7f0d77fc65d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2baf8e86e147dfb83287a10be41043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:38Z,use_quota=True,user_id='cc2111f947884a89b294c8c528fd8dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c372996-9795-49bf-8e52-166e982c180e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c372996-9795-49bf-8e52-166e982c180e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1e9ea5-0f46-4be3-8ed4-d921fbb33e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1e9ea5-0f46-4be3-8ed4-d921fbb33e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd115c4f9-9c24-460c-9d1a-7f0d77fc65d9', 'volume_name': 'volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb4f0e5-60de-48f1-a5f9-2ae5fb884853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb4f0e5-60de-48f1-a5f9-2ae5fb884853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3932fb-dcff-40be-b003-042e1d9a67f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:38 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume d115c4f9-9c24-460c-9d1a-7f0d77fc65d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9', 'volume_size': 1} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:38 devstack sudo[114393]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Flow 'volume_create_manager' (54316582-22b1-4cfa-bbd5-fa06c0ee2f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf2b97a-e36b-4ad1-a5fd-ac8c55fac119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-54466fd2-d512-49c8-b5d7-68e78b833366 1073741824" returned: 0 in 0.587s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf2b97a-e36b-4ad1-a5fd-ac8c55fac119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-853624781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e297e4-f893-4d2f-921b-d2f788ff19ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2baf8e86e147dfb83287a10be41043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:39Z,use_quota=True,user_id='cc2111f947884a89b294c8c528fd8dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc4eb6c-1487-4167-99bb-e99eedaffcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc4eb6c-1487-4167-99bb-e99eedaffcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8046fe4f-4e16-4e9e-853d-6f582a1ee613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8046fe4f-4e16-4e9e-853d-6f582a1ee613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e297e4-f893-4d2f-921b-d2f788ff19ea', 'volume_name': 'volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d4aa9d-d0c8-4c2c-b48d-39c19a3274bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d4aa9d-d0c8-4c2c-b48d-39c19a3274bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cfa69b4-8acb-4517-a4a0-f8704a583d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:38 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume c1e297e4-f893-4d2f-921b-d2f788ff19ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea', 'volume_size': 1} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-54466fd2-d512-49c8-b5d7-68e78b833366 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:38 devstack sudo[114405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-54466fd2-d512-49c8-b5d7-68e78b833366 Aug 13 09:40:38 devstack sudo[114405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:38 devstack sudo[114405]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-54466fd2-d512-49c8-b5d7-68e78b833366" returned: 0 in 0.251s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.055s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1748513899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f38bfc-ddd2-46ba-a020-345d43c9b2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2baf8e86e147dfb83287a10be41043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:38Z,use_quota=True,user_id='cc2111f947884a89b294c8c528fd8dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Creating volume 77f38bfc-ddd2-46ba-a020-345d43c9b2d6 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:40:38 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abaa5401-a768-4421-8aad-ff15ad1fa1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54466fd2-d512-49c8-b5d7-68e78b833366', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:39 devstack sudo[114408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6 1073741824 Aug 13 09:40:39 devstack sudo[114408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c76f90b3-0f16-4f29-ae40-69175e0eda8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:39 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume volume-54466fd2-d512-49c8-b5d7-68e78b833366 (54466fd2-d512-49c8-b5d7-68e78b833366): created successfully Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c76f90b3-0f16-4f29-ae40-69175e0eda8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Flow 'volume_create_manager' (a4704408-eaf0-4e1a-9ed8-c100d2d5236f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:39 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-cc852aa3-e584-464c-b9b4-818088bf25c5 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Created volume successfully. Aug 13 09:40:39 devstack sudo[114408]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6 1073741824" returned: 0 in 0.414s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:39 devstack sudo[114413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6 Aug 13 09:40:39 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:39 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6" returned: 0 in 0.258s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.366s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-613313420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d115c4f9-9c24-460c-9d1a-7f0d77fc65d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2baf8e86e147dfb83287a10be41043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:38Z,use_quota=True,user_id='cc2111f947884a89b294c8c528fd8dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Creating volume d115c4f9-9c24-460c-9d1a-7f0d77fc65d9 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:40:39 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:39 devstack sudo[114416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9 1073741824 Aug 13 09:40:39 devstack sudo[114416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1eecae-64d1-4cee-a709-79ec646a9ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4dd928-21df-40c7-b764-ab9b00b8a871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:39 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6 (77f38bfc-ddd2-46ba-a020-345d43c9b2d6): created successfully Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4dd928-21df-40c7-b764-ab9b00b8a871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Flow 'volume_create_manager' (5a7aeb84-5932-41f0-9f21-ef8f9558ef9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:39 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d7caee98-ee86-45c8-bd8e-2749a7884a2c tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Created volume successfully. Aug 13 09:40:40 devstack sudo[114416]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9 1073741824" returned: 0 in 0.408s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:40 devstack sudo[114423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9 Aug 13 09:40:40 devstack sudo[114423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:40 devstack sudo[114423]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9" returned: 0 in 0.235s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.682s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-853624781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e297e4-f893-4d2f-921b-d2f788ff19ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2baf8e86e147dfb83287a10be41043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:39Z,use_quota=True,user_id='cc2111f947884a89b294c8c528fd8dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Creating volume c1e297e4-f893-4d2f-921b-d2f788ff19ea {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:40:40 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3932fb-dcff-40be-b003-042e1d9a67f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:40 devstack sudo[114426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea 1073741824 Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6fce8f-a233-49c1-9691-374c0d23c007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:40 devstack sudo[114426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:40 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9 (d115c4f9-9c24-460c-9d1a-7f0d77fc65d9): created successfully Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6fce8f-a233-49c1-9691-374c0d23c007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Flow 'volume_create_manager' (18e2eee5-b653-448e-a256-1364a380a683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:40 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-9d88d3e3-208b-40ad-9753-f0b2ce6d07b3 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Created volume successfully. Aug 13 09:40:40 devstack sudo[114426]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea 1073741824" returned: 0 in 0.424s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:40 devstack sudo[114432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea Aug 13 09:40:40 devstack sudo[114432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:41 devstack sudo[114432]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea" returned: 0 in 0.261s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:40:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cfa69b4-8acb-4517-a4a0-f8704a583d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a17054-a342-439a-a541-7bac8ec8e2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:41 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Volume volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea (c1e297e4-f893-4d2f-921b-d2f788ff19ea): created successfully Aug 13 09:40:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a17054-a342-439a-a541-7bac8ec8e2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Flow 'volume_create_manager' (54316582-22b1-4cfa-bbd5-fa06c0ee2f92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:41 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3be9f5d9-8596-48af-a6ee-17cff3bcb689 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Created volume successfully. Aug 13 09:40:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "cinder-c1e297e4-f893-4d2f-921b-d2f788ff19ea-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-c1e297e4-f893-4d2f-921b-d2f788ff19ea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "cinder-quobyte-c1e297e4-f893-4d2f-921b-d2f788ff19ea" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-quobyte-c1e297e4-f893-4d2f-921b-d2f788ff19ea" acquired by "delete_volume" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[08154c82-fddd-4577-a826-17f88b7bcac5]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:42 devstack sudo[114435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea Aug 13 09:40:42 devstack sudo[114435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:42 devstack sudo[114435]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea" returned: 0 in 0.346s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:42 devstack sudo[114440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea Aug 13 09:40:42 devstack sudo[114440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:42 devstack sudo[114440]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1e297e4-f893-4d2f-921b-d2f788ff19ea" returned: 0 in 0.241s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-quobyte-c1e297e4-f893-4d2f-921b-d2f788ff19ea" released by "delete_volume" :: held 0.622s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Created reservations ['8e34b713-ba8e-4c85-813d-4a035665fafc', '1ed0983d-f6bb-4e5f-9f97-ebccee5a4da6', '0e916b9e-a8e0-4163-897d-9bc2fa38ca7e', '3f43b987-610a-43b2-857d-7075c08c7b6c'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:42 devstack sudo[114443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:40:42 devstack sudo[114443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:43 devstack sudo[114443]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.244s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:40:43 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Deleted volume successfully. Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-159a2c44-6ade-4f95-805d-9a44cfb75673 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-c1e297e4-f893-4d2f-921b-d2f788ff19ea-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "cinder-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "cinder-quobyte-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-quobyte-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef557823-6b24-42a7-869d-7ccc40cc84b4]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:43 devstack sudo[114446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:40:43 devstack sudo[114446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:43 devstack sudo[114447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9 Aug 13 09:40:43 devstack sudo[114447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:43 devstack sudo[114446]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.241s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:40:43 devstack sudo[114447]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9" returned: 0 in 0.366s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:43 devstack sudo[114454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9 Aug 13 09:40:43 devstack sudo[114454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:43 devstack sudo[114454]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9" returned: 0 in 0.238s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-quobyte-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9" released by "delete_volume" :: held 0.655s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Created reservations ['5258408b-488e-4d50-bb44-e830c1753802', 'f030ab20-eac0-4e25-83a9-dea38f82b16b', '621bb65a-162a-4161-943a-f2c57920471e', 'dd5942d5-23cb-42a5-9a2b-776d20da97dc'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:44 devstack sudo[114457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:40:44 devstack sudo[114457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:44 devstack sudo[114457]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.244s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:44 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:40:44 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Deleted volume successfully. Aug 13 09:40:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5e5368a8-e948-41de-8523-eac25556eb74 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-d115c4f9-9c24-460c-9d1a-7f0d77fc65d9-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "cinder-77f38bfc-ddd2-46ba-a020-345d43c9b2d6-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-77f38bfc-ddd2-46ba-a020-345d43c9b2d6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "cinder-quobyte-77f38bfc-ddd2-46ba-a020-345d43c9b2d6" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-quobyte-77f38bfc-ddd2-46ba-a020-345d43c9b2d6" acquired by "delete_volume" :: waited 0.014s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:44 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcd24a6-03aa-41b9-b7eb-7a6346c67ccb]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:44 devstack sudo[114460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6 Aug 13 09:40:44 devstack sudo[114460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:44 devstack sudo[114460]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6" returned: 0 in 0.409s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:44 devstack sudo[114465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6 Aug 13 09:40:44 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:45 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77f38bfc-ddd2-46ba-a020-345d43c9b2d6" returned: 0 in 0.252s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-quobyte-77f38bfc-ddd2-46ba-a020-345d43c9b2d6" released by "delete_volume" :: held 0.699s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Created reservations ['e35055ac-2ee4-4f3a-9b77-7ec1dd839e5c', '1f911dcf-11a8-4200-afbf-30c86c26e837', '3b015c36-d272-4354-b838-900a25769f53', 'c2df995a-2f79-4487-93fd-1b8fbc62d06a'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:45 devstack sudo[114468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:40:45 devstack sudo[114468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:45 devstack sudo[114468]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.259s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:40:45 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Deleted volume successfully. Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "cinder-54466fd2-d512-49c8-b5d7-68e78b833366-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e06f52f5-9840-425e-8ff6-ed7a7b3659ff tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-77f38bfc-ddd2-46ba-a020-345d43c9b2d6-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-54466fd2-d512-49c8-b5d7-68e78b833366-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "cinder-quobyte-54466fd2-d512-49c8-b5d7-68e78b833366" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-quobyte-54466fd2-d512-49c8-b5d7-68e78b833366" acquired by "delete_volume" :: waited 0.014s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72b387b-a51e-4914-9aad-89cdbdb35ff9]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-54466fd2-d512-49c8-b5d7-68e78b833366 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:45 devstack sudo[114471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-54466fd2-d512-49c8-b5d7-68e78b833366 Aug 13 09:40:45 devstack sudo[114471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:45 devstack sudo[114471]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-54466fd2-d512-49c8-b5d7-68e78b833366" returned: 0 in 0.368s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-54466fd2-d512-49c8-b5d7-68e78b833366 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:45 devstack sudo[114476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-54466fd2-d512-49c8-b5d7-68e78b833366 Aug 13 09:40:45 devstack sudo[114476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:46 devstack sudo[114476]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-54466fd2-d512-49c8-b5d7-68e78b833366" returned: 0 in 0.266s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-quobyte-54466fd2-d512-49c8-b5d7-68e78b833366" released by "delete_volume" :: held 0.678s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:46 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Created reservations ['4ae838f8-c1e3-43a1-a97e-b49e92e79f97', 'a3714dc3-252d-4452-94ee-a0b3a3075ade', '8a8f1d0f-b9ea-4bca-a11e-1e0f5e9ab036', '101b568b-6fa9-4681-b1f2-456b7a8d78f3'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:40:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:46 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:46 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:46 devstack sudo[114479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:40:46 devstack sudo[114479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:46 devstack sudo[114479]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.252s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:46 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:40:46 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Deleted volume successfully. Aug 13 09:40:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9cca9366-dd76-4464-b5bc-afc41a62f9f1 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-54466fd2-d512-49c8-b5d7-68e78b833366-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "cinder-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "cinder-quobyte-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-quobyte-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd" acquired by "delete_volume" :: waited 0.014s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:47 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[589035a3-3cf5-4b5f-b354-37f6ef295447]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:47 devstack sudo[114482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd Aug 13 09:40:47 devstack sudo[114482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:47 devstack sudo[114482]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd" returned: 0 in 0.371s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:47 devstack sudo[114488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd Aug 13 09:40:47 devstack sudo[114488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:47 devstack sudo[114488]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd" returned: 0 in 0.257s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-quobyte-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd" released by "delete_volume" :: held 0.672s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:47 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Created reservations ['0e986ad3-df3e-4465-a591-431999fcd2e2', '26e3697e-4ea5-4b90-824e-30fc3876a3cc', '77241913-3109-4e5d-a895-874f529389d9', '172e5eaf-5f5b-4675-8981-9e852a437d41'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:40:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:47 devstack sudo[114491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:40:47 devstack sudo[114491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "cinder-a50f1651-cd57-49ad-87aa-42f0a5707aa1-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:48 devstack sudo[114491]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-a50f1651-cd57-49ad-87aa-42f0a5707aa1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.261s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:48 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:40:48 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Deleted volume successfully. Aug 13 09:40:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f47f7b5b-01ed-43ee-9397-16ef3860ad06 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-69912f7f-a0a0-4ae1-b26f-9cbab345ebbd-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "cinder-quobyte-a50f1651-cd57-49ad-87aa-42f0a5707aa1" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-quobyte-a50f1651-cd57-49ad-87aa-42f0a5707aa1" acquired by "delete_volume" :: waited 0.013s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:48 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c00d7b-d3d8-4a12-b269-a8da68f3d564]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:48 devstack sudo[114494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1 Aug 13 09:40:48 devstack sudo[114494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:48 devstack sudo[114494]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1" returned: 0 in 0.412s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:48 devstack sudo[114499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1 Aug 13 09:40:48 devstack sudo[114499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:48 devstack sudo[114499]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a50f1651-cd57-49ad-87aa-42f0a5707aa1" returned: 0 in 0.277s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-quobyte-a50f1651-cd57-49ad-87aa-42f0a5707aa1" released by "delete_volume" :: held 0.730s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:48 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Created reservations ['12628fd7-e2d2-4fb9-bb11-ffd01af2baa8', 'fbd72875-9521-4016-991a-df8e12dcfc00', '72474533-05d3-4e03-8099-e450dac79809', 'dda74fda-e599-4290-be9a-41961cb832d9'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:40:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:49 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:49 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:49 devstack sudo[114502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:40:49 devstack sudo[114502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:49 devstack sudo[114502]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.257s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:49 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:40:49 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Deleted volume successfully. Aug 13 09:40:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-36f1069c-131f-4290-b0f1-3d5213cb3f97 tempest-CreateVolumesFromSourceVolumeTest-577321443 None] Lock "cinder-a50f1651-cd57-49ad-87aa-42f0a5707aa1-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Flow 'volume_create_manager' (d5f46db2-fa07-44aa-9f48-b36a96d96ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6edc031-49b8-4636-93a5-b63301931359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6edc031-49b8-4636-93a5-b63301931359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1767164157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e7637e-1880-44f3-afab-4f9bf4f35432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104a3365507043e3847929890e293576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:52Z,use_quota=True,user_id='e6f391871f3f462799a59639776d6a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0283dd6f-7b00-497e-b069-d9a1495420f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0283dd6f-7b00-497e-b069-d9a1495420f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064c78cd-6d75-4850-8e69-5497975b4879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064c78cd-6d75-4850-8e69-5497975b4879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94e7637e-1880-44f3-afab-4f9bf4f35432', 'volume_name': 'volume-94e7637e-1880-44f3-afab-4f9bf4f35432', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4f08b5-6e88-44ec-ad0f-61511f65fbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4f08b5-6e88-44ec-ad0f-61511f65fbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eedc7ed0-dfc2-4ec6-b64c-7328b7924049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:52 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Volume 94e7637e-1880-44f3-afab-4f9bf4f35432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94e7637e-1880-44f3-afab-4f9bf4f35432', 'volume_size': 1} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1767164157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e7637e-1880-44f3-afab-4f9bf4f35432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104a3365507043e3847929890e293576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:52Z,use_quota=True,user_id='e6f391871f3f462799a59639776d6a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Creating volume 94e7637e-1880-44f3-afab-4f9bf4f35432 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:40:52 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:52 devstack sudo[114506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 1073741824 Aug 13 09:40:52 devstack sudo[114506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:52 devstack sudo[114506]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 1073741824" returned: 0 in 0.460s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:52 devstack sudo[114511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 Aug 13 09:40:52 devstack sudo[114511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:53 devstack sudo[114511]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432" returned: 0 in 0.254s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:40:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eedc7ed0-dfc2-4ec6-b64c-7328b7924049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94e7637e-1880-44f3-afab-4f9bf4f35432', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799b6b6e-41af-4856-9cba-786b19a5498b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:53 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Volume volume-94e7637e-1880-44f3-afab-4f9bf4f35432 (94e7637e-1880-44f3-afab-4f9bf4f35432): created successfully Aug 13 09:40:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799b6b6e-41af-4856-9cba-786b19a5498b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Flow 'volume_create_manager' (d5f46db2-fa07-44aa-9f48-b36a96d96ddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:53 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-f3581357-ef68-4b2d-9f49-b9b9321b4ca0 tempest-VolumeDependencyTests-1352911994 None] Created volume successfully. Aug 13 09:40:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] Creating offline snapshot 350bccd0-ae0a-407d-92aa-73b4fd2410f5 of volume 94e7637e-1880-44f3-afab-4f9bf4f35432 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:40:53 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc386fc-b8d9-4192-a876-eb3d72d8e87b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:53 devstack sudo[114514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 Aug 13 09:40:53 devstack sudo[114514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:54 devstack sudo[114514]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432" returned: 0 in 0.370s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:54 devstack sudo[114519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 1G Aug 13 09:40:54 devstack sudo[114519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:54 devstack sudo[114519]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 1G" returned: 0 in 0.405s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e7637e-1880-44f3-afab-4f9bf4f35432 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:54 devstack sudo[114524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e7637e-1880-44f3-afab-4f9bf4f35432 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 Aug 13 09:40:54 devstack sudo[114524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:54 devstack sudo[114524]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e7637e-1880-44f3-afab-4f9bf4f35432 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5" returned: 0 in 0.321s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:54 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 is being set with open permissions: ugo+rw Aug 13 09:40:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:54 devstack sudo[114529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 Aug 13 09:40:54 devstack sudo[114529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:54 devstack sudo[114529]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5" returned: 0 in 0.246s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:55 devstack sudo[114532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.info Aug 13 09:40:55 devstack sudo[114532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:55 devstack sudo[114532]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.info" returned: 0 in 0.243s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:55 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.info is being set with open permissions: ugo+rw Aug 13 09:40:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:55 devstack sudo[114535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.info Aug 13 09:40:55 devstack sudo[114535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:55 devstack sudo[114535]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.info" returned: 0 in 0.236s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:55 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-466bb839-ecbe-4dc2-ac17-8fed77218ce6 tempest-VolumeDependencyTests-1352911994 None] Create snapshot completed successfully Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Flow 'volume_create_manager' (f725ce2f-3704-43ec-aeef-07f1e7c87298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47269da-e4ea-48b1-949a-49c4d67d1c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47269da-e4ea-48b1-949a-49c4d67d1c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1658470877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc36e8c-20b4-49f9-8531-b05ccafc2814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104a3365507043e3847929890e293576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=350bccd0-ae0a-407d-92aa-73b4fd2410f5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:40:56Z,use_quota=True,user_id='e6f391871f3f462799a59639776d6a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a55657a-133c-4842-80dc-d14293b78442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a55657a-133c-4842-80dc-d14293b78442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e75edbc-1613-4423-b789-99fec9934bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e75edbc-1613-4423-b789-99fec9934bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bdc36e8c-20b4-49f9-8531-b05ccafc2814', 'volume_name': 'volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814', 'volume_size': 1, 'snapshot_id': '350bccd0-ae0a-407d-92aa-73b4fd2410f5'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ec3dcf-1c93-402d-becc-7c88a2d698e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ec3dcf-1c93-402d-becc-7c88a2d698e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a0ce11-0b04-4562-8035-9ddaa1801ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:40:56 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Volume bdc36e8c-20b4-49f9-8531-b05ccafc2814: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814', 'volume_size': 1, 'snapshot_id': '350bccd0-ae0a-407d-92aa-73b4fd2410f5'} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "cinder-quobyte-350bccd0-ae0a-407d-92aa-73b4fd2410f5-bdc36e8c-20b4-49f9-8531-b05ccafc2814" by "_create_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-quobyte-350bccd0-ae0a-407d-92aa-73b4fd2410f5-bdc36e8c-20b4-49f9-8531-b05ccafc2814" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Creating volume bdc36e8c-20b4-49f9-8531-b05ccafc2814 from snapshot 350bccd0-ae0a-407d-92aa-73b4fd2410f5 {{(pid=94670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "cinder-quobyte-bdc36e8c-20b4-49f9-8531-b05ccafc2814" by "_copy_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-quobyte-bdc36e8c-20b4-49f9-8531-b05ccafc2814" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] snapshot: 350bccd0-ae0a-407d-92aa-73b4fd2410f5, volume: bdc36e8c-20b4-49f9-8531-b05ccafc2814, {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e444cd-2c1e-4d15-a3bf-f3956908ac37]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:56 devstack sudo[114540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 Aug 13 09:40:56 devstack sudo[114540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:56 devstack sudo[114540]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5" returned: 0 in 0.391s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e7637e-1880-44f3-afab-4f9bf4f35432(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Creating direct copy from snapshot {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[33795872-ea59-47b9-9c21-35dda451b624]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:40:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:57 devstack sudo[114546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 Aug 13 09:40:57 devstack sudo[114546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:40:57 devstack sudo[114546]: pam_unix(sudo:session): session closed for user root Aug 13 09:40:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432" returned: 0 in 0.360s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:40:57 devstack cinder-volume[94670]: DEBUG cinder.utils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Path /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814 not found in is_blk_device check {{(pid=94670) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 13 09:40:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:40:57 devstack sudo[114552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814 Aug 13 09:40:57 devstack sudo[114552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:01 devstack sudo[114552]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814" returned: 0 in 4.015s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:01 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcdd751-d9ea-462d-8537-5fe8f1344917]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:41:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:01 devstack sudo[114566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 Aug 13 09:41:01 devstack sudo[114566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:01 devstack sudo[114566]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432" returned: 0 in 0.564s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:01 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Image conversion details: src /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432, size 1024.00 MB, duration 4.02 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814 {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:41:01 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Converted 1024.00 MB image at 254.95 MB/s Aug 13 09:41:01 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814 is being set with open permissions: ugo+rw Aug 13 09:41:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:01 devstack sudo[114571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814 Aug 13 09:41:01 devstack sudo[114571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:02 devstack sudo[114571]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814" returned: 0 in 0.241s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-quobyte-bdc36e8c-20b4-49f9-8531-b05ccafc2814" released by "_copy_volume_from_snapshot" :: held 5.685s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-quobyte-350bccd0-ae0a-407d-92aa-73b4fd2410f5-bdc36e8c-20b4-49f9-8531-b05ccafc2814" released by "_create_volume_from_snapshot" :: held 5.722s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.739s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a0ce11-0b04-4562-8035-9ddaa1801ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814', 'volume_size': 1, 'snapshot_id': '350bccd0-ae0a-407d-92aa-73b4fd2410f5'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693620ca-d1e1-40c2-8b83-d3bc5f194a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:02 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Volume volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814 (bdc36e8c-20b4-49f9-8531-b05ccafc2814): created successfully Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693620ca-d1e1-40c2-8b83-d3bc5f194a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Flow 'volume_create_manager' (f725ce2f-3704-43ec-aeef-07f1e7c87298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:41:02 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-a19bf4df-868e-4fd2-8eb3-db4f8e85bc5b tempest-VolumeDependencyTests-1352911994 None] Created volume successfully. Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "cinder-350bccd0-ae0a-407d-92aa-73b4fd2410f5-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-350bccd0-ae0a-407d-92aa-73b4fd2410f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "cinder-quobyte-94e7637e-1880-44f3-afab-4f9bf4f35432" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-quobyte-94e7637e-1880-44f3-afab-4f9bf4f35432" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "cinder-quobyte-350bccd0-ae0a-407d-92aa-73b4fd2410f5" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-quobyte-350bccd0-ae0a-407d-92aa-73b4fd2410f5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Deleting offline snapshot 350bccd0-ae0a-407d-92aa-73b4fd2410f5 of volume 94e7637e-1880-44f3-afab-4f9bf4f35432 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] snapshot_file for this snap is: volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f69fdc3-5d3c-463e-9ce5-6ae5dbc51988]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:41:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:03 devstack sudo[114574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 Aug 13 09:41:03 devstack sudo[114574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:03 devstack sudo[114574]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5" returned: 0 in 0.341s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e7637e-1880-44f3-afab-4f9bf4f35432(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:41:03 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2086bfa4-ac98-459a-9400-da26dd0fc862]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:41:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:03 devstack sudo[114579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 Aug 13 09:41:03 devstack sudo[114579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:03 devstack sudo[114579]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432" returned: 0 in 0.346s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:03 devstack sudo[114584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 Aug 13 09:41:03 devstack sudo[114584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:04 devstack sudo[114584]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5" returned: 0 in 0.360s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:04 devstack sudo[114589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5 Aug 13 09:41:04 devstack sudo[114589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:04 devstack sudo[114589]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432.350bccd0-ae0a-407d-92aa-73b4fd2410f5" returned: 0 in 0.240s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-quobyte-350bccd0-ae0a-407d-92aa-73b4fd2410f5" released by "_delete_snapshot" :: held 1.378s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:41:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-quobyte-94e7637e-1880-44f3-afab-4f9bf4f35432" released by "delete_snapshot" :: held 1.401s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:41:04 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Created reservations ['8bb122a6-5465-413c-8770-98623745d583', '83461d84-b238-40c6-861f-d9dbdac3ffdc', 'ef482ba6-a5df-4375-9944-e496da0e2381', '3baf37c1-9596-4a71-b57a-bb9108f903e9'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:41:04 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Delete snapshot completed successfully. Aug 13 09:41:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d13d934f-9241-48c7-b62a-9ab4c02b8784 tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-350bccd0-ae0a-407d-92aa-73b4fd2410f5-delete_snapshot" released by "delete_snapshot" :: held 1.534s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "cinder-94e7637e-1880-44f3-afab-4f9bf4f35432-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-94e7637e-1880-44f3-afab-4f9bf4f35432-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "cinder-quobyte-94e7637e-1880-44f3-afab-4f9bf4f35432" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-quobyte-94e7637e-1880-44f3-afab-4f9bf4f35432" acquired by "delete_volume" :: waited 0.014s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed43db3-9202-4177-a7e8-c9e6f5b175ca]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:05 devstack sudo[114593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 Aug 13 09:41:05 devstack sudo[114593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:05 devstack sudo[114593]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432" returned: 0 in 0.355s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:05 devstack sudo[114598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432 Aug 13 09:41:05 devstack sudo[114598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:05 devstack sudo[114598]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-94e7637e-1880-44f3-afab-4f9bf4f35432" returned: 0 in 0.266s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-quobyte-94e7637e-1880-44f3-afab-4f9bf4f35432" released by "delete_volume" :: held 0.683s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Created reservations ['622a97fd-8650-49c7-a12c-faa60b92093d', '19c66f29-e1ec-4416-93f0-891bf8acfa54', '903acf21-79c8-432c-b0c5-8e3c4994484b', '2848fc0e-d78c-469c-b727-c2d450c94e9d'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:41:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:05 devstack sudo[114601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:41:05 devstack sudo[114601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:06 devstack sudo[114601]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.252s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:06 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:41:06 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Deleted volume successfully. Aug 13 09:41:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6f55157b-c212-41c4-9ede-4806fd2005b5 tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-94e7637e-1880-44f3-afab-4f9bf4f35432-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:41:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "cinder-bdc36e8c-20b4-49f9-8531-b05ccafc2814-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:41:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-bdc36e8c-20b4-49f9-8531-b05ccafc2814-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:41:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "cinder-quobyte-bdc36e8c-20b4-49f9-8531-b05ccafc2814" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:41:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-quobyte-bdc36e8c-20b4-49f9-8531-b05ccafc2814" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:41:06 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c112581f-df82-4a6a-8d0d-f760c8c54a59]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:41:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:06 devstack sudo[114604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814 Aug 13 09:41:06 devstack sudo[114604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:06 devstack sudo[114604]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814" returned: 0 in 0.417s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:06 devstack sudo[114609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814 Aug 13 09:41:06 devstack sudo[114609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:06 devstack sudo[114609]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bdc36e8c-20b4-49f9-8531-b05ccafc2814" returned: 0 in 0.260s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-quobyte-bdc36e8c-20b4-49f9-8531-b05ccafc2814" released by "delete_volume" :: held 0.720s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:41:07 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Created reservations ['fe736cd4-16b9-4001-8ada-269f4e93bad7', '5f920863-51be-4827-8e85-b690c118f8fb', '2e1f71a8-485a-46af-98d9-c6d5ce229cf4', '2bf691fe-58b7-41d5-8687-5497048995ab'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:41:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:41:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:41:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:41:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:41:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:41:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:07 devstack sudo[114612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:41:07 devstack sudo[114612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:07 devstack sudo[114612]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.292s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:07 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:41:07 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Deleted volume successfully. Aug 13 09:41:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ff3cf057-7791-41be-b917-60df839958d8 tempest-VolumeDependencyTests-1352911994 None] Lock "cinder-bdc36e8c-20b4-49f9-8531-b05ccafc2814-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=168,cinder:SELECT=116,cinder:INSERT=45,cinder:DELETE=19 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=119,cinder:UPDATE=168,cinder:INSERT=34,cinder:DELETE=11 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Flow 'volume_create_manager' (e1b1d480-5500-4228-a3a3-93bbbf7bf696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1eafeb8-8c3b-45cd-b25a-4dba9f29256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1eafeb8-8c3b-45cd-b25a-4dba9f29256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-301772005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1266fecb-8b2b-4a13-9103-e268ee7018c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc09a26bef74f328c5330baf4ae6c0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:41:11Z,use_quota=True,user_id='9357b25fc6ff4793888766608b0c8884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3750db-6ab5-4d4a-a3ba-af797ef4b06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3750db-6ab5-4d4a-a3ba-af797ef4b06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bec31b1-8841-4ed9-8329-234989f05607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bec31b1-8841-4ed9-8329-234989f05607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1266fecb-8b2b-4a13-9103-e268ee7018c4', 'volume_name': 'volume-1266fecb-8b2b-4a13-9103-e268ee7018c4', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59b43015-aa18-4621-a18c-d58fab0d2998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59b43015-aa18-4621-a18c-d58fab0d2998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462455d9-1a95-43b1-b82a-620b47a25982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:11 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Volume 1266fecb-8b2b-4a13-9103-e268ee7018c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1266fecb-8b2b-4a13-9103-e268ee7018c4', 'volume_size': 1} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-301772005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1266fecb-8b2b-4a13-9103-e268ee7018c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc09a26bef74f328c5330baf4ae6c0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:41:11Z,use_quota=True,user_id='9357b25fc6ff4793888766608b0c8884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Creating volume 1266fecb-8b2b-4a13-9103-e268ee7018c4 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:41:11 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1266fecb-8b2b-4a13-9103-e268ee7018c4 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:11 devstack sudo[114617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1266fecb-8b2b-4a13-9103-e268ee7018c4 1073741824 Aug 13 09:41:11 devstack sudo[114617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:11 devstack sudo[114617]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1266fecb-8b2b-4a13-9103-e268ee7018c4 1073741824" returned: 0 in 0.474s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1266fecb-8b2b-4a13-9103-e268ee7018c4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:11 devstack sudo[114623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1266fecb-8b2b-4a13-9103-e268ee7018c4 Aug 13 09:41:11 devstack sudo[114623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:12 devstack sudo[114623]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1266fecb-8b2b-4a13-9103-e268ee7018c4" returned: 0 in 0.241s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:41:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:41:12 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462455d9-1a95-43b1-b82a-620b47a25982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1266fecb-8b2b-4a13-9103-e268ee7018c4', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:12 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5490520c-2495-4295-ad04-892aa9ebc181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:12 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Volume volume-1266fecb-8b2b-4a13-9103-e268ee7018c4 (1266fecb-8b2b-4a13-9103-e268ee7018c4): created successfully Aug 13 09:41:12 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5490520c-2495-4295-ad04-892aa9ebc181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:12 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Flow 'volume_create_manager' (e1b1d480-5500-4228-a3a3-93bbbf7bf696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:41:12 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c3845306-2710-434b-9a2f-340f5dcfa7e7 tempest-ProjectReaderTests-102950159 None] Created volume successfully. Aug 13 09:41:13 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Acquiring lock "cinder-1266fecb-8b2b-4a13-9103-e268ee7018c4-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:41:13 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Lock "cinder-1266fecb-8b2b-4a13-9103-e268ee7018c4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:41:13 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Acquiring lock "cinder-quobyte-1266fecb-8b2b-4a13-9103-e268ee7018c4" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:41:13 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Lock "cinder-quobyte-1266fecb-8b2b-4a13-9103-e268ee7018c4" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:41:13 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6513c4-6920-4c2a-9fa0-893c4779cfbf]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:41:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1266fecb-8b2b-4a13-9103-e268ee7018c4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:13 devstack sudo[114626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1266fecb-8b2b-4a13-9103-e268ee7018c4 Aug 13 09:41:13 devstack sudo[114626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:13 devstack sudo[114626]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1266fecb-8b2b-4a13-9103-e268ee7018c4" returned: 0 in 0.359s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1266fecb-8b2b-4a13-9103-e268ee7018c4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:13 devstack sudo[114631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1266fecb-8b2b-4a13-9103-e268ee7018c4 Aug 13 09:41:13 devstack sudo[114631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:14 devstack sudo[114631]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1266fecb-8b2b-4a13-9103-e268ee7018c4" returned: 0 in 0.250s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Lock "cinder-quobyte-1266fecb-8b2b-4a13-9103-e268ee7018c4" released by "delete_volume" :: held 0.651s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:41:14 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Created reservations ['3045a682-f317-4f6a-89f9-a19f325b894c', '2264a2d5-f272-44de-9abe-c42aa60298ba', 'df84eeeb-ed92-4508-afb0-2351bced367e', 'c4d43767-21f6-4eb5-a6ef-d7febc437196'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:41:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:41:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:41:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:41:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:41:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:41:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:14 devstack sudo[114634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:41:14 devstack sudo[114634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:14 devstack sudo[114634]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.258s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:14 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:41:14 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Deleted volume successfully. Aug 13 09:41:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-42afb200-4ff3-455c-a65d-4bb5b1eadb0f tempest-ProjectReaderTests-102950159 None] Lock "cinder-1266fecb-8b2b-4a13-9103-e268ee7018c4-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Flow 'volume_create_manager' (f0c7575f-cc6f-4a13-a537-c649c9091b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a77fa68-8c3a-41cd-8cc9-16e51158fd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a77fa68-8c3a-41cd-8cc9-16e51158fd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697672192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1cec279-e50a-4900-9814-33cd90265b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc09a26bef74f328c5330baf4ae6c0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:41:15Z,use_quota=True,user_id='9357b25fc6ff4793888766608b0c8884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f0f512-d2e8-422c-b929-ab80e1c684ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f0f512-d2e8-422c-b929-ab80e1c684ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b6f371-43a4-44a2-94ef-09dc0a64da0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b6f371-43a4-44a2-94ef-09dc0a64da0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1cec279-e50a-4900-9814-33cd90265b0b', 'volume_name': 'volume-c1cec279-e50a-4900-9814-33cd90265b0b', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf783881-dc7b-4575-b865-bf79ecf47ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf783881-dc7b-4575-b865-bf79ecf47ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf06df9-8c6b-4e5a-9811-8fdb78829c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:15 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Volume c1cec279-e50a-4900-9814-33cd90265b0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1cec279-e50a-4900-9814-33cd90265b0b', 'volume_size': 1} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697672192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1cec279-e50a-4900-9814-33cd90265b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc09a26bef74f328c5330baf4ae6c0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:41:15Z,use_quota=True,user_id='9357b25fc6ff4793888766608b0c8884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Creating volume c1cec279-e50a-4900-9814-33cd90265b0b {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:41:15 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cec279-e50a-4900-9814-33cd90265b0b 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:15 devstack sudo[114637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cec279-e50a-4900-9814-33cd90265b0b 1073741824 Aug 13 09:41:15 devstack sudo[114637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:15 devstack sudo[114637]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cec279-e50a-4900-9814-33cd90265b0b 1073741824" returned: 0 in 0.415s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cec279-e50a-4900-9814-33cd90265b0b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:15 devstack sudo[114643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cec279-e50a-4900-9814-33cd90265b0b Aug 13 09:41:15 devstack sudo[114643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:15 devstack sudo[114643]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cec279-e50a-4900-9814-33cd90265b0b" returned: 0 in 0.265s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf06df9-8c6b-4e5a-9811-8fdb78829c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1cec279-e50a-4900-9814-33cd90265b0b', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a21e2b2-5ed7-4464-9e27-7beeb437dc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:15 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Volume volume-c1cec279-e50a-4900-9814-33cd90265b0b (c1cec279-e50a-4900-9814-33cd90265b0b): created successfully Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a21e2b2-5ed7-4464-9e27-7beeb437dc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:15 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Flow 'volume_create_manager' (f0c7575f-cc6f-4a13-a537-c649c9091b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:41:15 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-585f2da9-2597-4a98-acfb-6be779da8fde tempest-ProjectReaderTests-102950159 None] Created volume successfully. Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Acquiring lock "cinder-c1cec279-e50a-4900-9814-33cd90265b0b-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Lock "cinder-c1cec279-e50a-4900-9814-33cd90265b0b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Acquiring lock "cinder-quobyte-c1cec279-e50a-4900-9814-33cd90265b0b" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Lock "cinder-quobyte-c1cec279-e50a-4900-9814-33cd90265b0b" acquired by "delete_volume" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6b452b-336b-45df-8b50-cf52317d9109]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cec279-e50a-4900-9814-33cd90265b0b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:16 devstack sudo[114646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cec279-e50a-4900-9814-33cd90265b0b Aug 13 09:41:16 devstack sudo[114646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:16 devstack sudo[114646]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cec279-e50a-4900-9814-33cd90265b0b" returned: 0 in 0.371s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cec279-e50a-4900-9814-33cd90265b0b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:16 devstack sudo[114651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cec279-e50a-4900-9814-33cd90265b0b Aug 13 09:41:16 devstack sudo[114651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:16 devstack sudo[114651]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cec279-e50a-4900-9814-33cd90265b0b" returned: 0 in 0.263s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Lock "cinder-quobyte-c1cec279-e50a-4900-9814-33cd90265b0b" released by "delete_volume" :: held 0.670s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Created reservations ['f3bdd6c1-e5c6-4260-8060-139de90151b1', '5730ce4b-f647-426f-b3cc-9b1335ee4331', '1dc1e878-78cc-49fe-be1d-f65322674df1', '699445b2-b72c-46a3-bc47-d805ec5e6071'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:41:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:16 devstack sudo[114654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:41:16 devstack sudo[114654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:17 devstack sudo[114654]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.267s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:17 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:41:17 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Deleted volume successfully. Aug 13 09:41:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-95ec91b0-7fc7-40e5-9a01-a915d4919ada tempest-ProjectReaderTests-102950159 None] Lock "cinder-c1cec279-e50a-4900-9814-33cd90265b0b-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:41:26 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=24 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:41:27 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=14,cinder:UPDATE=19,cinder:DELETE=4,cinder:INSERT=4 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:41:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:41:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:41:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:41:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:41:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:41:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:41:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:43 devstack sudo[114705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:41:43 devstack sudo[114705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:43 devstack sudo[114705]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.282s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:41:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:41:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:41:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Flow 'volume_create_manager' (06e1e59a-cae4-4e82-b85f-93ad8268fe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c3a0f1-c12f-431f-8a3d-5a870030a994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c3a0f1-c12f-431f-8a3d-5a870030a994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1541859570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946ba263-151b-4632-a1b2-b65742e8ad4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8949241f9a4098a8991b82e17d1a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:41:50Z,use_quota=True,user_id='83d2c4a26b324a11b5bf5f44897743c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fcdea1-f07a-4382-959d-37943f90cb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fcdea1-f07a-4382-959d-37943f90cb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e89d9d1-d21e-4336-b492-0280cd5185d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e89d9d1-d21e-4336-b492-0280cd5185d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '946ba263-151b-4632-a1b2-b65742e8ad4d', 'volume_name': 'volume-946ba263-151b-4632-a1b2-b65742e8ad4d', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a338b3-45d2-47f4-bcdd-ff724ca3b6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a338b3-45d2-47f4-bcdd-ff724ca3b6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50937c1-5a24-4d76-ba46-bab0b332a989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:50 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Volume 946ba263-151b-4632-a1b2-b65742e8ad4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-946ba263-151b-4632-a1b2-b65742e8ad4d', 'volume_size': 1} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1541859570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946ba263-151b-4632-a1b2-b65742e8ad4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8949241f9a4098a8991b82e17d1a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:41:50Z,use_quota=True,user_id='83d2c4a26b324a11b5bf5f44897743c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Creating volume 946ba263-151b-4632-a1b2-b65742e8ad4d {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:41:50 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:41:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:50 devstack sudo[114709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d 1073741824 Aug 13 09:41:50 devstack sudo[114709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:51 devstack sudo[114709]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d 1073741824" returned: 0 in 0.414s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:51 devstack sudo[114715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d Aug 13 09:41:51 devstack sudo[114715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:51 devstack sudo[114715]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d" returned: 0 in 0.247s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:41:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:41:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50937c1-5a24-4d76-ba46-bab0b332a989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-946ba263-151b-4632-a1b2-b65742e8ad4d', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8b379c-1790-4723-8343-bd48bdc25ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:51 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Volume volume-946ba263-151b-4632-a1b2-b65742e8ad4d (946ba263-151b-4632-a1b2-b65742e8ad4d): created successfully Aug 13 09:41:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8b379c-1790-4723-8343-bd48bdc25ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Flow 'volume_create_manager' (06e1e59a-cae4-4e82-b85f-93ad8268fe44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:41:51 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c47070d3-6abd-40f7-a07f-ccd93d5d129c tempest-SnapshotDependencyTests-626711000 None] Created volume successfully. Aug 13 09:41:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:41:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:41:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] Creating offline snapshot 3d5d852b-8e60-49ea-b223-11880d4fa91f of volume 946ba263-151b-4632-a1b2-b65742e8ad4d {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:41:51 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4637270-e899-4dc6-97e3-6fa24ad60061]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:41:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:51 devstack sudo[114718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d Aug 13 09:41:51 devstack sudo[114718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:52 devstack sudo[114718]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d" returned: 0 in 0.354s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:52 devstack sudo[114723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f 1G Aug 13 09:41:52 devstack sudo[114723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:52 devstack sudo[114723]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f 1G" returned: 0 in 0.420s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-946ba263-151b-4632-a1b2-b65742e8ad4d -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:52 devstack sudo[114728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-946ba263-151b-4632-a1b2-b65742e8ad4d -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f Aug 13 09:41:52 devstack sudo[114728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:52 devstack sudo[114728]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-946ba263-151b-4632-a1b2-b65742e8ad4d -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f" returned: 0 in 0.299s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:52 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f is being set with open permissions: ugo+rw Aug 13 09:41:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:52 devstack sudo[114733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f Aug 13 09:41:52 devstack sudo[114733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:53 devstack sudo[114733]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f" returned: 0 in 0.250s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:53 devstack sudo[114736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.info Aug 13 09:41:53 devstack sudo[114736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:53 devstack sudo[114736]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.info" returned: 0 in 0.249s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:53 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.info is being set with open permissions: ugo+rw Aug 13 09:41:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:53 devstack sudo[114739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.info Aug 13 09:41:53 devstack sudo[114739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:53 devstack sudo[114739]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.info" returned: 0 in 0.247s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:41:53 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d521d924-9606-4583-b39d-d2ac31ecb7f4 tempest-SnapshotDependencyTests-626711000 None] Create snapshot completed successfully Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Flow 'volume_create_manager' (68527c44-a4d9-4bdc-b2e1-76e086dec954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ffcc258-8934-4d00-bc4d-ba7a620eefd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ffcc258-8934-4d00-bc4d-ba7a620eefd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826cda96-c01e-436e-b638-42b71c6ef1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8949241f9a4098a8991b82e17d1a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3d5d852b-8e60-49ea-b223-11880d4fa91f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:41:54Z,use_quota=True,user_id='83d2c4a26b324a11b5bf5f44897743c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1932e9-44e1-4862-b2ce-1c9f352c7b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1932e9-44e1-4862-b2ce-1c9f352c7b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee22ea6-927b-44d4-ab50-55c60844e174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee22ea6-927b-44d4-ab50-55c60844e174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '826cda96-c01e-436e-b638-42b71c6ef1bf', 'volume_name': 'volume-826cda96-c01e-436e-b638-42b71c6ef1bf', 'volume_size': 1, 'snapshot_id': '3d5d852b-8e60-49ea-b223-11880d4fa91f'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768d02c2-dd27-4437-abc6-480074b9db8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768d02c2-dd27-4437-abc6-480074b9db8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde39d9e-6b5a-4cbb-a807-4243dbee50f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:41:54 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Volume 826cda96-c01e-436e-b638-42b71c6ef1bf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-826cda96-c01e-436e-b638-42b71c6ef1bf', 'volume_size': 1, 'snapshot_id': '3d5d852b-8e60-49ea-b223-11880d4fa91f'} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "cinder-quobyte-3d5d852b-8e60-49ea-b223-11880d4fa91f-826cda96-c01e-436e-b638-42b71c6ef1bf" by "_create_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-quobyte-3d5d852b-8e60-49ea-b223-11880d4fa91f-826cda96-c01e-436e-b638-42b71c6ef1bf" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Creating volume 826cda96-c01e-436e-b638-42b71c6ef1bf from snapshot 3d5d852b-8e60-49ea-b223-11880d4fa91f {{(pid=94670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "cinder-quobyte-826cda96-c01e-436e-b638-42b71c6ef1bf" by "_copy_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-quobyte-826cda96-c01e-436e-b638-42b71c6ef1bf" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] snapshot: 3d5d852b-8e60-49ea-b223-11880d4fa91f, volume: 826cda96-c01e-436e-b638-42b71c6ef1bf, {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbf1f06-04ee-44cc-ba0c-119f9419efb9]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:41:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:54 devstack sudo[114742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f Aug 13 09:41:54 devstack sudo[114742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:55 devstack sudo[114742]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f" returned: 0 in 0.397s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-946ba263-151b-4632-a1b2-b65742e8ad4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:41:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 13 09:41:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Creating direct copy from snapshot {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 13 09:41:55 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[427f04e5-3a35-46ce-b6c9-98943d6dfb25]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:41:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:55 devstack sudo[114747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d Aug 13 09:41:55 devstack sudo[114747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:55 devstack sudo[114747]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d" returned: 0 in 0.404s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:55 devstack cinder-volume[94670]: DEBUG cinder.utils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Path /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-826cda96-c01e-436e-b638-42b71c6ef1bf not found in is_blk_device check {{(pid=94670) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 13 09:41:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-826cda96-c01e-436e-b638-42b71c6ef1bf {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:55 devstack sudo[114753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-826cda96-c01e-436e-b638-42b71c6ef1bf Aug 13 09:41:55 devstack sudo[114753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:41:59 devstack sudo[114753]: pam_unix(sudo:session): session closed for user root Aug 13 09:41:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-826cda96-c01e-436e-b638-42b71c6ef1bf" returned: 0 in 4.199s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:41:59 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2791c7f4-6669-4599-bbad-7c8481e45a8c]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:41:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:41:59 devstack sudo[114768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d Aug 13 09:41:59 devstack sudo[114768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:00 devstack sudo[114768]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d" returned: 0 in 0.523s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:00 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Image conversion details: src /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d, size 1024.00 MB, duration 4.20 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-826cda96-c01e-436e-b638-42b71c6ef1bf {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:42:00 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Converted 1024.00 MB image at 243.81 MB/s Aug 13 09:42:00 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-826cda96-c01e-436e-b638-42b71c6ef1bf is being set with open permissions: ugo+rw Aug 13 09:42:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-826cda96-c01e-436e-b638-42b71c6ef1bf {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:00 devstack sudo[114774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-826cda96-c01e-436e-b638-42b71c6ef1bf Aug 13 09:42:00 devstack sudo[114774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:00 devstack sudo[114774]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-826cda96-c01e-436e-b638-42b71c6ef1bf" returned: 0 in 0.242s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-quobyte-826cda96-c01e-436e-b638-42b71c6ef1bf" released by "_copy_volume_from_snapshot" :: held 5.856s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-quobyte-3d5d852b-8e60-49ea-b223-11880d4fa91f-826cda96-c01e-436e-b638-42b71c6ef1bf" released by "_create_volume_from_snapshot" :: held 5.885s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.907s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde39d9e-6b5a-4cbb-a807-4243dbee50f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826cda96-c01e-436e-b638-42b71c6ef1bf', 'volume_size': 1, 'snapshot_id': '3d5d852b-8e60-49ea-b223-11880d4fa91f'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28070bcd-3a74-4428-9ae1-74bc8dba3ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:00 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Volume volume-826cda96-c01e-436e-b638-42b71c6ef1bf (826cda96-c01e-436e-b638-42b71c6ef1bf): created successfully Aug 13 09:42:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28070bcd-3a74-4428-9ae1-74bc8dba3ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Flow 'volume_create_manager' (68527c44-a4d9-4bdc-b2e1-76e086dec954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:00 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-a99e1c0e-2846-4689-9105-1f88a75f0888 tempest-SnapshotDependencyTests-626711000 None] Created volume successfully. Aug 13 09:42:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "cinder-3d5d852b-8e60-49ea-b223-11880d4fa91f-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-3d5d852b-8e60-49ea-b223-11880d4fa91f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "cinder-quobyte-946ba263-151b-4632-a1b2-b65742e8ad4d" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-quobyte-946ba263-151b-4632-a1b2-b65742e8ad4d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "cinder-quobyte-3d5d852b-8e60-49ea-b223-11880d4fa91f" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-quobyte-3d5d852b-8e60-49ea-b223-11880d4fa91f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Deleting offline snapshot 3d5d852b-8e60-49ea-b223-11880d4fa91f of volume 946ba263-151b-4632-a1b2-b65742e8ad4d {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:42:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] snapshot_file for this snap is: volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:42:01 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca387c0-ee1f-484b-9575-e56fe8837200]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:01 devstack sudo[114777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f Aug 13 09:42:01 devstack sudo[114777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:01 devstack sudo[114777]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f" returned: 0 in 0.361s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-946ba263-151b-4632-a1b2-b65742e8ad4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:42:01 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff90beb9-b602-4709-ba1a-655d352ade7e]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:01 devstack sudo[114782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d Aug 13 09:42:01 devstack sudo[114782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:02 devstack sudo[114782]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d" returned: 0 in 0.353s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:02 devstack sudo[114787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f Aug 13 09:42:02 devstack sudo[114787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:02 devstack sudo[114787]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f" returned: 0 in 0.387s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:02 devstack sudo[114792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f Aug 13 09:42:02 devstack sudo[114792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:02 devstack sudo[114792]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d.3d5d852b-8e60-49ea-b223-11880d4fa91f" returned: 0 in 0.256s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-quobyte-3d5d852b-8e60-49ea-b223-11880d4fa91f" released by "_delete_snapshot" :: held 1.477s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-quobyte-946ba263-151b-4632-a1b2-b65742e8ad4d" released by "delete_snapshot" :: held 1.502s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:02 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Created reservations ['9f0f3e2b-183c-45e2-bf0a-125446590ff1', 'f4c6f472-3677-42e3-aa21-255fc7bddb21', '2e20bdb1-bb22-4e23-9996-44ae12f6a14c', '1ea2070c-38fe-4a1b-82ea-934b74aae0a5'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:42:02 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Delete snapshot completed successfully. Aug 13 09:42:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-13cc2e99-7259-43fe-b270-1df507b54484 tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-3d5d852b-8e60-49ea-b223-11880d4fa91f-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:03 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "cinder-946ba263-151b-4632-a1b2-b65742e8ad4d-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:03 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-946ba263-151b-4632-a1b2-b65742e8ad4d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:03 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "cinder-quobyte-946ba263-151b-4632-a1b2-b65742e8ad4d" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:03 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-quobyte-946ba263-151b-4632-a1b2-b65742e8ad4d" acquired by "delete_volume" :: waited 0.013s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:03 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c3c5ad-5ca9-4194-ae11-d5fe13a054dc]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:03 devstack sudo[114795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d Aug 13 09:42:03 devstack sudo[114795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:04 devstack sudo[114795]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d" returned: 0 in 0.396s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:04 devstack sudo[114800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d Aug 13 09:42:04 devstack sudo[114800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:04 devstack sudo[114800]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-946ba263-151b-4632-a1b2-b65742e8ad4d" returned: 0 in 0.255s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-quobyte-946ba263-151b-4632-a1b2-b65742e8ad4d" released by "delete_volume" :: held 0.709s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Created reservations ['8476a999-8a2d-4837-82f5-3ccb96ac12e4', 'c911e4b0-3a9d-4593-a171-a1c92c635c1e', '9dcfeae0-4d3c-490b-a9fd-9217df35a8b3', '5f8ccb2c-fc02-4752-8b55-5aa5c71543e0'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:04 devstack sudo[114804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:42:04 devstack sudo[114804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:04 devstack sudo[114804]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "cinder-826cda96-c01e-436e-b638-42b71c6ef1bf-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.290s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:42:04 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Deleted volume successfully. Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-826cda96-c01e-436e-b638-42b71c6ef1bf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5bdbbcbd-9813-4c13-b500-6863c5ce2a51 tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-946ba263-151b-4632-a1b2-b65742e8ad4d-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "cinder-quobyte-826cda96-c01e-436e-b638-42b71c6ef1bf" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-quobyte-826cda96-c01e-436e-b638-42b71c6ef1bf" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cf65d2-7d84-4e2e-a7b4-6456449bb974]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-826cda96-c01e-436e-b638-42b71c6ef1bf {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:04 devstack sudo[114807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-826cda96-c01e-436e-b638-42b71c6ef1bf Aug 13 09:42:04 devstack sudo[114807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:05 devstack sudo[114807]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-826cda96-c01e-436e-b638-42b71c6ef1bf" returned: 0 in 0.352s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-826cda96-c01e-436e-b638-42b71c6ef1bf {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:05 devstack sudo[114812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-826cda96-c01e-436e-b638-42b71c6ef1bf Aug 13 09:42:05 devstack sudo[114812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:05 devstack sudo[114812]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-826cda96-c01e-436e-b638-42b71c6ef1bf" returned: 0 in 0.243s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-quobyte-826cda96-c01e-436e-b638-42b71c6ef1bf" released by "delete_volume" :: held 0.631s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:05 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Created reservations ['84c08316-369a-4dc9-ab72-d193268fcceb', 'b33c7bdb-98a0-4b35-bbc9-802b912aaeb4', 'a31c0074-99fc-4ad5-96b1-315bb1ff41a6', '640dfb73-87cb-49bb-8620-f5f65a8dd0da'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:42:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:05 devstack sudo[114815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:42:05 devstack sudo[114815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:05 devstack sudo[114815]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.245s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:05 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:42:05 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Deleted volume successfully. Aug 13 09:42:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8c5c7c78-c0d9-49c9-b55f-e0aaa50c1b4a tempest-SnapshotDependencyTests-626711000 None] Lock "cinder-826cda96-c01e-436e-b638-42b71c6ef1bf-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:15 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=21,cinder:UPDATE=29,cinder:INSERT=5,cinder:DELETE=1 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:42:15 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=26,cinder:UPDATE=27,cinder:DELETE=4,cinder:INSERT=9 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:42:28 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Flow 'volume_create_manager' (c0edc019-d39b-4804-bd68-cea206e2e07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46dea0b-fcc0-46fe-bbc3-d4dce31f08c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46dea0b-fcc0-46fe-bbc3-d4dce31f08c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1186471369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5f361d-c287-4c26-b05d-a841bd89de21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0e253c3adc495ebba4b40e54da708d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:29Z,use_quota=True,user_id='349dd34024e240659035abc1434cfc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8292d2-bc31-459e-bc6c-bb5b28b77080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8292d2-bc31-459e-bc6c-bb5b28b77080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c97165-3bd4-4bd8-b6d8-7e8d4c8b5f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:28 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c97165-3bd4-4bd8-b6d8-7e8d4c8b5f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba5f361d-c287-4c26-b05d-a841bd89de21', 'volume_name': 'volume-ba5f361d-c287-4c26-b05d-a841bd89de21', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130a4a4f-a11d-4707-b23b-09430b15fd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130a4a4f-a11d-4707-b23b-09430b15fd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18f7a9d-5cbf-4756-8418-b707c43f94e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:29 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Volume ba5f361d-c287-4c26-b05d-a841bd89de21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba5f361d-c287-4c26-b05d-a841bd89de21', 'volume_size': 1} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1186471369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5f361d-c287-4c26-b05d-a841bd89de21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0e253c3adc495ebba4b40e54da708d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:29Z,use_quota=True,user_id='349dd34024e240659035abc1434cfc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Creating volume ba5f361d-c287-4c26-b05d-a841bd89de21 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:42:29 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:29 devstack sudo[114864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 1073741824 Aug 13 09:42:29 devstack sudo[114864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Flow 'volume_create_manager' (8b5e56d0-2191-4a8d-9734-7c71af3bcf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7310e58-9512-42b2-9a3b-14b3a9f0f6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7310e58-9512-42b2-9a3b-14b3a9f0f6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-126223579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d92727-0e8f-4437-96b9-373b72b87feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53807cc8e9842129e74c72c3348d205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:29Z,use_quota=True,user_id='376f8e774f5246dbb8a61618b2cc4de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89d6196-5c98-4a92-b8a6-c5f4f153bae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89d6196-5c98-4a92-b8a6-c5f4f153bae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfa2f09-d196-49e1-b5ef-035383750180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfa2f09-d196-49e1-b5ef-035383750180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d92727-0e8f-4437-96b9-373b72b87feb', 'volume_name': 'volume-77d92727-0e8f-4437-96b9-373b72b87feb', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaef074-6ab8-4c7b-9ed3-9b2541c9c790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaef074-6ab8-4c7b-9ed3-9b2541c9c790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff19086-dafa-4565-a2e4-ae12c7769d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:29 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Volume 77d92727-0e8f-4437-96b9-373b72b87feb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d92727-0e8f-4437-96b9-373b72b87feb', 'volume_size': 1} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:29 devstack sudo[114864]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 1073741824" returned: 0 in 0.737s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Flow 'volume_create_manager' (6224b06a-7a9f-4c1f-8f0e-eb3bb11c1963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8eca06a-d90f-4352-9d0a-c82f6c638047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8eca06a-d90f-4352-9d0a-c82f6c638047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1623324282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b8cb1d-84d9-4822-9f26-6de42a9f68e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53807cc8e9842129e74c72c3348d205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:30Z,use_quota=True,user_id='376f8e774f5246dbb8a61618b2cc4de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2386f10d-65bc-4e0f-b4d0-00c466f0e785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2386f10d-65bc-4e0f-b4d0-00c466f0e785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26386c1-0f57-4694-a5d2-7a08a2e8b824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26386c1-0f57-4694-a5d2-7a08a2e8b824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3b8cb1d-84d9-4822-9f26-6de42a9f68e1', 'volume_name': 'volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca72c0b-e717-4041-a259-b0432c808354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca72c0b-e717-4041-a259-b0432c808354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9346528f-1dfb-467e-8a1f-5f5850c04e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:29 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Volume c3b8cb1d-84d9-4822-9f26-6de42a9f68e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1', 'volume_size': 1} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:29 devstack sudo[114869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 Aug 13 09:42:29 devstack sudo[114869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:30 devstack sudo[114869]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21" returned: 0 in 0.403s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-126223579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d92727-0e8f-4437-96b9-373b72b87feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53807cc8e9842129e74c72c3348d205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:29Z,use_quota=True,user_id='376f8e774f5246dbb8a61618b2cc4de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Creating volume 77d92727-0e8f-4437-96b9-373b72b87feb {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:42:30 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77d92727-0e8f-4437-96b9-373b72b87feb 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18f7a9d-5cbf-4756-8418-b707c43f94e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba5f361d-c287-4c26-b05d-a841bd89de21', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e7fb28-8c02-4dcc-9936-a38047402fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:30 devstack sudo[114874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77d92727-0e8f-4437-96b9-373b72b87feb 1073741824 Aug 13 09:42:30 devstack sudo[114874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:30 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Volume volume-ba5f361d-c287-4c26-b05d-a841bd89de21 (ba5f361d-c287-4c26-b05d-a841bd89de21): created successfully Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e7fb28-8c02-4dcc-9936-a38047402fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Flow 'volume_create_manager' (c0edc019-d39b-4804-bd68-cea206e2e07b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Flow 'volume_create_manager' (acb7ff42-9f67-4791-915d-05a005c8764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a921a557-a302-4826-ba71-54786c665b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:30 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-8bffa4a6-b2e0-45ca-aea3-a3d48ebaad45 tempest-VolumeDependencyTests-1518468860 None] Created volume successfully. Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a921a557-a302-4826-ba71-54786c665b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1380395678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a77813-92c4-42b2-bbd5-36408af84364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53807cc8e9842129e74c72c3348d205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:30Z,use_quota=True,user_id='376f8e774f5246dbb8a61618b2cc4de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd22fa5f-338e-470e-8fb5-3d2d44098d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd22fa5f-338e-470e-8fb5-3d2d44098d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028354ad-e342-448e-9f07-f184d37b6bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028354ad-e342-448e-9f07-f184d37b6bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91a77813-92c4-42b2-bbd5-36408af84364', 'volume_name': 'volume-91a77813-92c4-42b2-bbd5-36408af84364', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3510c3ab-6ec8-4ef7-9c3a-038aa1cb03db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3510c3ab-6ec8-4ef7-9c3a-038aa1cb03db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3e7136-addd-45e0-9a50-5bd5be0efe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:30 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Volume 91a77813-92c4-42b2-bbd5-36408af84364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91a77813-92c4-42b2-bbd5-36408af84364', 'volume_size': 1} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Flow 'volume_create_manager' (0c8d51cf-58b4-4565-9980-a7233b222a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04415f76-4aab-493b-8b67-9598a17a8a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04415f76-4aab-493b-8b67-9598a17a8a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-18831397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0e2f3c-a867-4fc2-8720-7556bd882aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53807cc8e9842129e74c72c3348d205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:31Z,use_quota=True,user_id='376f8e774f5246dbb8a61618b2cc4de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfab9bf4-b700-4ae4-ad00-258e0645973b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfab9bf4-b700-4ae4-ad00-258e0645973b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db4b9ab-b858-4e99-961b-0cce18b0a7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db4b9ab-b858-4e99-961b-0cce18b0a7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0e2f3c-a867-4fc2-8720-7556bd882aed', 'volume_name': 'volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e00b8ff-650c-42ee-af96-283894ceceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e00b8ff-650c-42ee-af96-283894ceceba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c319976-71bd-4d06-93bc-0270b7f19ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:30 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Volume 8a0e2f3c-a867-4fc2-8720-7556bd882aed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed', 'volume_size': 1} Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:30 devstack sudo[114874]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77d92727-0e8f-4437-96b9-373b72b87feb 1073741824" returned: 0 in 0.590s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77d92727-0e8f-4437-96b9-373b72b87feb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:31 devstack sudo[114881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77d92727-0e8f-4437-96b9-373b72b87feb Aug 13 09:42:31 devstack sudo[114881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Flow 'volume_create_manager' (5655e5a8-1eea-4f72-af0f-5c04c7728058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9400de2d-3c17-4d8e-8777-bd555f2538c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9400de2d-3c17-4d8e-8777-bd555f2538c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1982815447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf44b2ff-e6e9-4e0d-81a3-408c9e789483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53807cc8e9842129e74c72c3348d205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:31Z,use_quota=True,user_id='376f8e774f5246dbb8a61618b2cc4de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89d577e-260a-4aea-a05a-dde3378cb4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89d577e-260a-4aea-a05a-dde3378cb4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4db36c9-f64b-4eb8-b447-1a24c4e0ccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4db36c9-f64b-4eb8-b447-1a24c4e0ccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf44b2ff-e6e9-4e0d-81a3-408c9e789483', 'volume_name': 'volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaff958c-4a21-4a0e-ad3c-f680e14527ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaff958c-4a21-4a0e-ad3c-f680e14527ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8cde7a-808a-423c-a1f3-6025f8cb6ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:31 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Volume bf44b2ff-e6e9-4e0d-81a3-408c9e789483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483', 'volume_size': 1} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:31 devstack sudo[114881]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77d92727-0e8f-4437-96b9-373b72b87feb" returned: 0 in 0.482s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1623324282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b8cb1d-84d9-4822-9f26-6de42a9f68e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53807cc8e9842129e74c72c3348d205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:30Z,use_quota=True,user_id='376f8e774f5246dbb8a61618b2cc4de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Creating volume c3b8cb1d-84d9-4822-9f26-6de42a9f68e1 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:42:31 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:31 devstack sudo[114884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1 1073741824 Aug 13 09:42:31 devstack sudo[114884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff19086-dafa-4565-a2e4-ae12c7769d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d92727-0e8f-4437-96b9-373b72b87feb', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14aa8304-2b14-4b0b-b7b6-dd55c55ecd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:31 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Volume volume-77d92727-0e8f-4437-96b9-373b72b87feb (77d92727-0e8f-4437-96b9-373b72b87feb): created successfully Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14aa8304-2b14-4b0b-b7b6-dd55c55ecd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Flow 'volume_create_manager' (8b5e56d0-2191-4a8d-9734-7c71af3bcf78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:31 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-ffbccf6c-8d44-432a-9583-4a9ee72340a9 tempest-CreateVolumesFromImageTest-248646357 None] Created volume successfully. Aug 13 09:42:32 devstack sudo[114884]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1 1073741824" returned: 0 in 0.541s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:32 devstack sudo[114890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1 Aug 13 09:42:32 devstack sudo[114890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:32 devstack sudo[114890]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1" returned: 0 in 0.299s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.781s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1380395678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a77813-92c4-42b2-bbd5-36408af84364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53807cc8e9842129e74c72c3348d205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:30Z,use_quota=True,user_id='376f8e774f5246dbb8a61618b2cc4de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Creating volume 91a77813-92c4-42b2-bbd5-36408af84364 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:42:32 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-91a77813-92c4-42b2-bbd5-36408af84364 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9346528f-1dfb-467e-8a1f-5f5850c04e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea93fc3-13bf-4a2f-b8b7-bd0421a73076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:32 devstack sudo[114893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-91a77813-92c4-42b2-bbd5-36408af84364 1073741824 Aug 13 09:42:32 devstack sudo[114893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:32 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Volume volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1 (c3b8cb1d-84d9-4822-9f26-6de42a9f68e1): created successfully Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea93fc3-13bf-4a2f-b8b7-bd0421a73076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Flow 'volume_create_manager' (6224b06a-7a9f-4c1f-8f0e-eb3bb11c1963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:32 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-7ea7f837-9081-4a39-97c5-eca657a76074 tempest-CreateVolumesFromImageTest-248646357 None] Created volume successfully. Aug 13 09:42:32 devstack sudo[114893]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-91a77813-92c4-42b2-bbd5-36408af84364 1073741824" returned: 0 in 0.559s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-91a77813-92c4-42b2-bbd5-36408af84364 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:33 devstack sudo[114913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-91a77813-92c4-42b2-bbd5-36408af84364 Aug 13 09:42:33 devstack sudo[114913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:33 devstack sudo[114913]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-91a77813-92c4-42b2-bbd5-36408af84364" returned: 0 in 0.255s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.364s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-18831397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0e2f3c-a867-4fc2-8720-7556bd882aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53807cc8e9842129e74c72c3348d205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:31Z,use_quota=True,user_id='376f8e774f5246dbb8a61618b2cc4de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Creating volume 8a0e2f3c-a867-4fc2-8720-7556bd882aed {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:42:33 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3e7136-addd-45e0-9a50-5bd5be0efe63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91a77813-92c4-42b2-bbd5-36408af84364', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:33 devstack sudo[114936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed 1073741824 Aug 13 09:42:33 devstack sudo[114936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1403dea6-d24f-44e8-b2ee-09cd1e9ff2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:33 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Volume volume-91a77813-92c4-42b2-bbd5-36408af84364 (91a77813-92c4-42b2-bbd5-36408af84364): created successfully Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1403dea6-d24f-44e8-b2ee-09cd1e9ff2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:33 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Flow 'volume_create_manager' (acb7ff42-9f67-4791-915d-05a005c8764c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:33 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-078ee570-1aee-404a-b946-4929678eac38 tempest-CreateVolumesFromImageTest-248646357 None] Created volume successfully. Aug 13 09:42:34 devstack sudo[114936]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed 1073741824" returned: 0 in 0.779s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Flow 'volume_create_manager' (bfb47e01-fbb8-40e6-82f5-9c8f0b7bdb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfa27c8-c5dd-4073-82e0-be92642e0051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfa27c8-c5dd-4073-82e0-be92642e0051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2357a5e9-a557-4b52-88ce-afa9d2e23e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff2f5f83cb6452dab0c8db8b29fcf46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:34Z,use_quota=True,user_id='97ec18b321e7445c8082092febdfe15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50c273d0-bbba-48c8-8e90-5fda37f68af2),volume_type_id=50c273d0-bbba-48c8-8e90-5fda37f68af2)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d501b832-51c0-4f78-a77c-77cac24958a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d501b832-51c0-4f78-a77c-77cac24958a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:34 devstack sudo[114944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed Aug 13 09:42:34 devstack sudo[114944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e1a507-263d-4b21-9225-817fb45f8f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.image.glance [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Creating Keystone auth plugin from conf {{(pid=94670) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 13 09:42:34 devstack sudo[114944]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed" returned: 0 in 0.276s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.028s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1982815447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf44b2ff-e6e9-4e0d-81a3-408c9e789483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53807cc8e9842129e74c72c3348d205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:31Z,use_quota=True,user_id='376f8e774f5246dbb8a61618b2cc4de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Creating volume bf44b2ff-e6e9-4e0d-81a3-408c9e789483 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:42:34 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:34 devstack sudo[114947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483 1073741824 Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c319976-71bd-4d06-93bc-0270b7f19ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:34 devstack sudo[114947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc1f706-fbc4-42c3-85a1-e3142aa0d9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:34 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Volume volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed (8a0e2f3c-a867-4fc2-8720-7556bd882aed): created successfully Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc1f706-fbc4-42c3-85a1-e3142aa0d9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Flow 'volume_create_manager' (0c8d51cf-58b4-4565-9980-a7233b222a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:34 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3e5a5fe7-82ef-4931-b32d-121b4a5145ff tempest-CreateVolumesFromImageTest-248646357 None] Created volume successfully. Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e1a507-263d-4b21-9225-817fb45f8f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2357a5e9-a557-4b52-88ce-afa9d2e23e23', 'volume_name': 'volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23', 'volume_size': 1, 'image_id': 'eb7e6359-0fe5-4c01-84a5-7386d377e3d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb7e6359-0fe5-4c01-84a5-7386d377e3d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '86f345eea2d8ce070182556b8b601162', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ff2f5f83cb6452dab0c8db8b29fcf46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f73f2f6ebf65a686eb883ff28a496762f41324ce0d3eeeaa31381e9387a3162541bbefbaef1b38b1afb7a01ca473e7e90e71fdaff63c7cc8d68aa2d4a5f4afbe', 'id': 'eb7e6359-0fe5-4c01-84a5-7386d377e3d3', 'created_at': datetime.datetime(2026, 8, 13, 7, 42, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 42, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb7e6359-0fe5-4c01-84a5-7386d377e3d3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f778156e-5fec-41c5-8e9a-98744304449c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f778156e-5fec-41c5-8e9a-98744304449c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bef2ff-9a29-4ce6-9b6a-58a5c2245b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:34 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Volume 2357a5e9-a557-4b52-88ce-afa9d2e23e23: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23', 'volume_size': 1, 'image_id': 'eb7e6359-0fe5-4c01-84a5-7386d377e3d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb7e6359-0fe5-4c01-84a5-7386d377e3d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '86f345eea2d8ce070182556b8b601162', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ff2f5f83cb6452dab0c8db8b29fcf46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f73f2f6ebf65a686eb883ff28a496762f41324ce0d3eeeaa31381e9387a3162541bbefbaef1b38b1afb7a01ca473e7e90e71fdaff63c7cc8d68aa2d4a5f4afbe', 'id': 'eb7e6359-0fe5-4c01-84a5-7386d377e3d3', 'created_at': datetime.datetime(2026, 8, 13, 7, 42, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 42, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb7e6359-0fe5-4c01-84a5-7386d377e3d3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Trying to clone 2357a5e9-a557-4b52-88ce-afa9d2e23e23 from image eb7e6359-0fe5-4c01-84a5-7386d377e3d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eb7e6359-0fe5-4c01-84a5-7386d377e3d3', 'metadata': {}}]). {{(pid=94670) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 13 09:42:34 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Image download 0.00 MB at 0.00 MB/s Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f079268-b6e8-48e3-9446-55617e74a9f2]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:35 devstack sudo[114952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD Aug 13 09:42:35 devstack sudo[114952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:35 devstack sudo[114947]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483 1073741824" returned: 0 in 0.597s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:35 devstack sudo[114954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483 Aug 13 09:42:35 devstack sudo[114954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:35 devstack sudo[114952]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:35 devstack sudo[114954]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483" returned: 0 in 0.251s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.739s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8cde7a-808a-423c-a1f3-6025f8cb6ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e42c72-63ff-4ddf-95ad-3fb49c09b9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:35 devstack sudo[114958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD Aug 13 09:42:35 devstack sudo[114958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] Creating offline snapshot 6b65355b-18e2-445c-8398-e4d86024f351 of volume ba5f361d-c287-4c26-b05d-a841bd89de21 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:42:35 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Volume volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483 (bf44b2ff-e6e9-4e0d-81a3-408c9e789483): created successfully Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e42c72-63ff-4ddf-95ad-3fb49c09b9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Flow 'volume_create_manager' (5655e5a8-1eea-4f72-af0f-5c04c7728058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1c4c13-364b-460e-b0f0-fb047e8258ff]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:35 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6685ffd0-11a8-4115-b3dd-960059d83869 tempest-CreateVolumesFromImageTest-248646357 None] Created volume successfully. Aug 13 09:42:35 devstack sudo[114961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 Aug 13 09:42:35 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:35 devstack sudo[114958]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Temporary image eb7e6359-0fe5-4c01-84a5-7386d377e3d3 is fetched for user 97ec18b321e7445c8082092febdfe15b. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cec3cd-02dd-4c52-b4f4-1b57c5aa52ce]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:35 devstack sudo[114966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD Aug 13 09:42:35 devstack sudo[114966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:35 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21" returned: 0 in 0.438s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:35 devstack sudo[114971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 1G Aug 13 09:42:35 devstack sudo[114971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "cinder-bf44b2ff-e6e9-4e0d-81a3-408c9e789483-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-bf44b2ff-e6e9-4e0d-81a3-408c9e789483-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "cinder-quobyte-bf44b2ff-e6e9-4e0d-81a3-408c9e789483" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-quobyte-bf44b2ff-e6e9-4e0d-81a3-408c9e789483" acquired by "delete_volume" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2865c4c-3ced-421b-a8ff-1ad6b84af2e1]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:36 devstack sudo[114966]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:36 devstack sudo[114973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483 Aug 13 09:42:36 devstack sudo[114973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:36 devstack sudo[114980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD Aug 13 09:42:36 devstack sudo[114980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:36 devstack sudo[114971]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 1G" returned: 0 in 0.610s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5f361d-c287-4c26-b05d-a841bd89de21 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:36 devstack sudo[114987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5f361d-c287-4c26-b05d-a841bd89de21 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 Aug 13 09:42:36 devstack sudo[114987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:36 devstack sudo[114973]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483" returned: 0 in 0.468s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:36 devstack sudo[114989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483 Aug 13 09:42:36 devstack sudo[114989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:36 devstack sudo[114980]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD" returned: 1 in 0.470s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:36 devstack sudo[114989]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf44b2ff-e6e9-4e0d-81a3-408c9e789483" returned: 0 in 0.280s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-quobyte-bf44b2ff-e6e9-4e0d-81a3-408c9e789483" released by "delete_volume" :: held 0.816s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:36 devstack sudo[114987]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5f361d-c287-4c26-b05d-a841bd89de21 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351" returned: 0 in 0.377s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:36 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 is being set with open permissions: ugo+rw Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:36 devstack sudo[114999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 Aug 13 09:42:36 devstack sudo[114999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Created reservations ['a2c941e3-bf64-4360-a6df-eb52ac20c18e', '36e2466d-de88-4b14-b351-cd1c74311cc0', '81d1394a-20b8-4859-937f-74a9fd8c8bc5', '2d046b2a-3116-470c-9d88-c3b750824a0b'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:37 devstack sudo[115001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:42:37 devstack sudo[115001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:37 devstack sudo[114999]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351" returned: 0 in 0.305s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "cinder-8a0e2f3c-a867-4fc2-8720-7556bd882aed-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:37 devstack sudo[115004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.info Aug 13 09:42:37 devstack sudo[115004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-8a0e2f3c-a867-4fc2-8720-7556bd882aed-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "cinder-quobyte-8a0e2f3c-a867-4fc2-8720-7556bd882aed" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-quobyte-8a0e2f3c-a867-4fc2-8720-7556bd882aed" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:37 devstack sudo[115001]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.352s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:42:37 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Deleted volume successfully. Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4450732-a8da-433f-abe8-bf579c9dc915]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-cb63cd7a-d697-4861-9731-8496eab2c918 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-bf44b2ff-e6e9-4e0d-81a3-408c9e789483-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:37 devstack sudo[115004]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.info" returned: 0 in 0.330s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:37 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.info is being set with open permissions: ugo+rw Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:37 devstack sudo[115007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed Aug 13 09:42:37 devstack sudo[115007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:37 devstack sudo[115009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.info Aug 13 09:42:37 devstack sudo[115009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:37 devstack sudo[115009]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.info" returned: 0 in 0.313s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.541s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.193s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2357a5e9-a557-4b52-88ce-afa9d2e23e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff2f5f83cb6452dab0c8db8b29fcf46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:34Z,use_quota=True,user_id='97ec18b321e7445c8082092febdfe15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50c273d0-bbba-48c8-8e90-5fda37f68af2),volume_type_id=50c273d0-bbba-48c8-8e90-5fda37f68af2)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Creating volume 2357a5e9-a557-4b52-88ce-afa9d2e23e23 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:42:37 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:37 devstack sudo[115007]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed" returned: 0 in 0.528s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:37 devstack sudo[115016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 1073741824 Aug 13 09:42:37 devstack sudo[115016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:37 devstack sudo[115018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed Aug 13 09:42:37 devstack sudo[115018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:37 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e633fde5-a34a-4bb7-a314-f22a94237e0d tempest-VolumeDependencyTests-1518468860 None] Create snapshot completed successfully Aug 13 09:42:38 devstack sudo[115018]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-8a0e2f3c-a867-4fc2-8720-7556bd882aed" returned: 0 in 0.301s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-quobyte-8a0e2f3c-a867-4fc2-8720-7556bd882aed" released by "delete_volume" :: held 0.894s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Created reservations ['13a98460-9b1b-456c-a489-9ee335f4767c', 'cc8b5571-d92e-4953-9ad2-46d259e32bfd', '6092d7ce-2354-4056-b2d3-c889d3fce6e7', '09f51d2e-2c2d-41c5-aeb3-9b5a34afe2ef'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:38 devstack sudo[115016]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 1073741824" returned: 0 in 0.568s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:38 devstack sudo[115027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:42:38 devstack sudo[115027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "cinder-91a77813-92c4-42b2-bbd5-36408af84364-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-91a77813-92c4-42b2-bbd5-36408af84364-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:38 devstack sudo[115032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 Aug 13 09:42:38 devstack sudo[115032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "cinder-quobyte-91a77813-92c4-42b2-bbd5-36408af84364" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-quobyte-91a77813-92c4-42b2-bbd5-36408af84364" acquired by "delete_volume" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d901420-bba6-4d64-bc46-607aa44df4e4]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-91a77813-92c4-42b2-bbd5-36408af84364 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:38 devstack sudo[115027]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.345s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:42:38 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Deleted volume successfully. Aug 13 09:42:38 devstack sudo[115034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-91a77813-92c4-42b2-bbd5-36408af84364 Aug 13 09:42:38 devstack sudo[115034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-65635a04-4af3-453b-9af7-a765b18afe03 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-8a0e2f3c-a867-4fc2-8720-7556bd882aed-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:38 devstack sudo[115032]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23" returned: 0 in 0.322s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:38 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Attempting download of eb7e6359-0fe5-4c01-84a5-7386d377e3d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb7e6359-0fe5-4c01-84a5-7386d377e3d3', 'metadata': {}}])) to volume 2357a5e9-a557-4b52-88ce-afa9d2e23e23. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07ad7e0-250e-4015-aa38-9c0d6b1ca48b]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_6w1t6gkm {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:39 devstack sudo[115034]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-91a77813-92c4-42b2-bbd5-36408af84364" returned: 0 in 0.476s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-91a77813-92c4-42b2-bbd5-36408af84364 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:39 devstack sudo[115042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-91a77813-92c4-42b2-bbd5-36408af84364 Aug 13 09:42:39 devstack sudo[115042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:39 devstack sudo[115041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_6w1t6gkm Aug 13 09:42:39 devstack sudo[115041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:39 devstack sudo[115042]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-91a77813-92c4-42b2-bbd5-36408af84364" returned: 0 in 0.405s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:39 devstack sudo[115041]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_6w1t6gkm" returned: 0 in 0.482s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_6w1t6gkm {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-quobyte-91a77813-92c4-42b2-bbd5-36408af84364" released by "delete_volume" :: held 0.952s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Created reservations ['aaf99d52-ad84-480a-beee-73f3445b6cf5', 'ca8dcf10-3ace-4d3a-882e-2ec295d3cf9c', '44d8b458-a0bd-44b5-b0c0-726b1db1a0b6', '64250669-6a86-4706-b297-66e763b25ad4'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:42:39 devstack sudo[115048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_6w1t6gkm Aug 13 09:42:39 devstack sudo[115048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Flow 'volume_create_manager' (17d5ef69-3d9a-4623-a2c3-e30b2a0e2b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303f84c6-c3ec-4be6-bea0-f6d22c0a3bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303f84c6-c3ec-4be6-bea0-f6d22c0a3bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-645351293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0e253c3adc495ebba4b40e54da708d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6b65355b-18e2-445c-8398-e4d86024f351,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:40Z,use_quota=True,user_id='349dd34024e240659035abc1434cfc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb1e679-1abe-4d6c-bfe1-c3d9862f1bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb1e679-1abe-4d6c-bfe1-c3d9862f1bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d46978-840f-43b9-8fb1-476dd0941386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d46978-840f-43b9-8fb1-476dd0941386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3', 'volume_name': 'volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3', 'volume_size': 1, 'snapshot_id': '6b65355b-18e2-445c-8398-e4d86024f351'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15946076-2703-46db-8453-626df20c9b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15946076-2703-46db-8453-626df20c9b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01280ba0-002e-4a9d-b557-fe0494610968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:39 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Volume 96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3', 'volume_size': 1, 'snapshot_id': '6b65355b-18e2-445c-8398-e4d86024f351'} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "cinder-quobyte-6b65355b-18e2-445c-8398-e4d86024f351-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3" by "_create_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-quobyte-6b65355b-18e2-445c-8398-e4d86024f351-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Creating volume 96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3 from snapshot 6b65355b-18e2-445c-8398-e4d86024f351 {{(pid=94670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "cinder-quobyte-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3" by "_copy_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:39 devstack sudo[115050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:42:39 devstack sudo[115050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-quobyte-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] snapshot: 6b65355b-18e2-445c-8398-e4d86024f351, volume: 96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3, {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96cc0b0-1371-4dee-b3cb-b4f69e6f9ad6]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:40 devstack sudo[115048]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_6w1t6gkm" returned: 1 in 0.451s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_6w1t6gkm' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc895be2-39c9-43c2-91a9-69a443560cae]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:40 devstack sudo[115054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 Aug 13 09:42:40 devstack sudo[115054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:40 devstack sudo[115055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD Aug 13 09:42:40 devstack sudo[115055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:40 devstack sudo[115050]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.300s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:42:40 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Deleted volume successfully. Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-6b42b297-86b3-491b-8750-f3a5c924b4c2 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-91a77813-92c4-42b2-bbd5-36408af84364-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:40 devstack sudo[115055]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:40 devstack sudo[115054]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351" returned: 0 in 0.454s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba5f361d-c287-4c26-b05d-a841bd89de21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Creating direct copy from snapshot {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ef98ea-734f-47b8-a84b-1c0a2c58dc82]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:40 devstack sudo[115066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD Aug 13 09:42:40 devstack sudo[115066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:40 devstack sudo[115067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 Aug 13 09:42:40 devstack sudo[115067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Flow 'volume_create_manager' (acded8bd-d9c1-46b1-8913-41fb0af8f728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a87031-8a83-42ec-90cf-104eac2ab358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "cinder-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:40 devstack sudo[115066]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD" returned: 1 in 0.431s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a87031-8a83-42ec-90cf-104eac2ab358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103719431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745e6915-d411-4467-8b29-bf7309df22a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aad89052f5e40a3867af35adc3995ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:41Z,use_quota=True,user_id='9e045da2146f4aa5998d0cc10a5d164c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1e631a-143d-4b5b-b685-10b6888438c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1e631a-143d-4b5b-b685-10b6888438c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b727b650-38be-4609-a6ed-4883514b4a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:40 devstack sudo[115067]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b727b650-38be-4609-a6ed-4883514b4a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '745e6915-d411-4467-8b29-bf7309df22a9', 'volume_name': 'volume-745e6915-d411-4467-8b29-bf7309df22a9', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73de512-1b39-481d-a22d-42432c4b62d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73de512-1b39-481d-a22d-42432c4b62d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3efc97-3a7c-4a22-aee3-61219ba464bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:40 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Volume 745e6915-d411-4467-8b29-bf7309df22a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-745e6915-d411-4467-8b29-bf7309df22a9', 'volume_size': 1} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] eb7e6359-0fe5-4c01-84a5-7386d377e3d3 was raw, converting to raw {{(pid=94670) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21" returned: 0 in 0.474s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:40 devstack sudo[115076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 Aug 13 09:42:40 devstack sudo[115076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.utils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Path /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3 not found in is_blk_device check {{(pid=94670) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:40 devstack sudo[115078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3 Aug 13 09:42:40 devstack sudo[115078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "cinder-quobyte-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-quobyte-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:41 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0642bdaf-9182-4402-afdc-88e1dbf9ab06]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:41 devstack sudo[115080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1 Aug 13 09:42:41 devstack sudo[115080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:41 devstack sudo[115076]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23" returned: 0 in 0.335s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:41 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eb7e6359-0fe5-4c01-84a5-7386d377e3d3_eijf06frdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:42:41 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Converted 0.00 MB image at 0.00 MB/s Aug 13 09:42:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:41 devstack sudo[115088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 1G Aug 13 09:42:41 devstack sudo[115088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:41 devstack sudo[115080]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1" returned: 0 in 0.405s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:41 devstack sudo[115100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1 Aug 13 09:42:41 devstack sudo[115100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:41 devstack sudo[115088]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 1G" returned: 0 in 0.694s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:42 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd78d80-7df3-4d7a-9a99-271d9d24767e]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:42 devstack sudo[115100]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1" returned: 0 in 0.666s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-quobyte-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1" released by "delete_volume" :: held 1.153s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:42 devstack sudo[115106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 Aug 13 09:42:42 devstack sudo[115106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:42 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Created reservations ['eb3023c2-430a-41c4-a917-29c2e451abf2', 'ec81fa74-9e01-4280-80e9-d14766de70a3', '69a20ea6-b90a-4652-bec4-69d8e5ffcc1d', '04d7e1f7-d274-47e9-bf9d-096378e7e6d0'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:42:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:42 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:42 devstack sudo[115109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:42:42 devstack sudo[115109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:43 devstack sudo[115106]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23" returned: 0 in 1.021s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:43 devstack sudo[115109]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.741s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "cinder-77d92727-0e8f-4437-96b9-373b72b87feb-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:42:43 devstack sudo[115115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:42:43 devstack sudo[115115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:43 devstack sudo[115113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 Aug 13 09:42:43 devstack sudo[115113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:43 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Deleted volume successfully. Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-86224df0-43e1-46b8-b73f-900e68c4628e tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-c3b8cb1d-84d9-4822-9f26-6de42a9f68e1-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-77d92727-0e8f-4437-96b9-373b72b87feb-delete_volume" acquired by "delete_volume" :: waited 0.152s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "cinder-quobyte-77d92727-0e8f-4437-96b9-373b72b87feb" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-quobyte-77d92727-0e8f-4437-96b9-373b72b87feb" acquired by "delete_volume" :: waited 0.041s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0a7e18-90eb-4845-a66b-aafba325939a]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77d92727-0e8f-4437-96b9-373b72b87feb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:43 devstack sudo[115118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77d92727-0e8f-4437-96b9-373b72b87feb Aug 13 09:42:43 devstack sudo[115118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:44 devstack sudo[115115]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.756s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:42:44 devstack sudo[115113]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23" returned: 1 in 1.146s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Downloaded image eb7e6359-0fe5-4c01-84a5-7386d377e3d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb7e6359-0fe5-4c01-84a5-7386d377e3d3', 'metadata': {}}])) to volume 2357a5e9-a557-4b52-88ce-afa9d2e23e23 successfully. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Temporary image eb7e6359-0fe5-4c01-84a5-7386d377e3d3 for user 97ec18b321e7445c8082092febdfe15b is deleted. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Marking volume 2357a5e9-a557-4b52-88ce-afa9d2e23e23 as bootable. {{(pid=94670) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Copying metadata from image eb7e6359-0fe5-4c01-84a5-7386d377e3d3 to 2357a5e9-a557-4b52-88ce-afa9d2e23e23. {{(pid=94670) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Creating volume glance metadata for volume 2357a5e9-a557-4b52-88ce-afa9d2e23e23 backed by image eb7e6359-0fe5-4c01-84a5-7386d377e3d3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'eb7e6359-0fe5-4c01-84a5-7386d377e3d3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '86f345eea2d8ce070182556b8b601162', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94670) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bef2ff-9a29-4ce6-9b6a-58a5c2245b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23', 'volume_size': 1, 'image_id': 'eb7e6359-0fe5-4c01-84a5-7386d377e3d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb7e6359-0fe5-4c01-84a5-7386d377e3d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '86f345eea2d8ce070182556b8b601162', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ff2f5f83cb6452dab0c8db8b29fcf46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f73f2f6ebf65a686eb883ff28a496762f41324ce0d3eeeaa31381e9387a3162541bbefbaef1b38b1afb7a01ca473e7e90e71fdaff63c7cc8d68aa2d4a5f4afbe', 'id': 'eb7e6359-0fe5-4c01-84a5-7386d377e3d3', 'created_at': datetime.datetime(2026, 8, 13, 7, 42, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 42, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb7e6359-0fe5-4c01-84a5-7386d377e3d3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e0f9e9-1ff8-402f-bf07-0e12bcd48708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:44 devstack sudo[115118]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77d92727-0e8f-4437-96b9-373b72b87feb" returned: 0 in 0.851s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77d92727-0e8f-4437-96b9-373b72b87feb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:44 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Volume volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 (2357a5e9-a557-4b52-88ce-afa9d2e23e23): created successfully Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e0f9e9-1ff8-402f-bf07-0e12bcd48708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:44 devstack sudo[115127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77d92727-0e8f-4437-96b9-373b72b87feb Aug 13 09:42:44 devstack sudo[115127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Flow 'volume_create_manager' (bfb47e01-fbb8-40e6-82f5-9c8f0b7bdb06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:44 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-7c2be1c8-dd24-4f5b-8fe1-339d3a181912 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Created volume successfully. Aug 13 09:42:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Acquiring lock "cinder-2357a5e9-a557-4b52-88ce-afa9d2e23e23-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:45 devstack sudo[115127]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Lock "cinder-2357a5e9-a557-4b52-88ce-afa9d2e23e23-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77d92727-0e8f-4437-96b9-373b72b87feb" returned: 0 in 0.710s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-quobyte-77d92727-0e8f-4437-96b9-373b72b87feb" released by "delete_volume" :: held 1.716s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Acquiring lock "cinder-quobyte-2357a5e9-a557-4b52-88ce-afa9d2e23e23" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:45 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Lock "cinder-quobyte-2357a5e9-a557-4b52-88ce-afa9d2e23e23" acquired by "delete_volume" :: waited 0.071s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:45 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dbba68-9190-4935-82a2-a07b50a8d513]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:45 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Created reservations ['53ff9b01-4e78-42c6-84c9-818b938be75d', '77ac0003-9073-419b-80ac-b243ed9be19b', '3d904302-2b8c-44a1-8105-5ff5a5d52903', '8f7b0df3-3c2f-4101-b41f-0f67e77b1847'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:42:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:45 devstack sudo[115131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:42:45 devstack sudo[115131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:45 devstack sudo[115130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 Aug 13 09:42:45 devstack sudo[115130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:46 devstack sudo[115078]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3" returned: 0 in 5.282s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1537486f-064e-4d46-abef-c457153fe572]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:46 devstack sudo[115131]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.487s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:42:46 devstack sudo[115130]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23" returned: 0 in 0.747s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:46 devstack sudo[115134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 Aug 13 09:42:46 devstack sudo[115134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:46 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Deleted volume successfully. Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b1c5cfde-3e99-4d12-a14b-eea5c67683a3 tempest-CreateVolumesFromImageTest-248646357 None] Lock "cinder-77d92727-0e8f-4437-96b9-373b72b87feb-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:46 devstack sudo[115139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 Aug 13 09:42:46 devstack sudo[115139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:46 devstack sudo[115139]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23" returned: 1 in 0.368s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:46 devstack sudo[115146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23 Aug 13 09:42:46 devstack sudo[115146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:46 devstack sudo[115134]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21" returned: 0 in 0.637s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Image conversion details: src /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3 {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:42:46 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Converted 1024.00 MB image at 193.81 MB/s Aug 13 09:42:46 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3 is being set with open permissions: ugo+rw Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:46 devstack sudo[115150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3 Aug 13 09:42:46 devstack sudo[115150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:46 devstack sudo[115146]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-2357a5e9-a557-4b52-88ce-afa9d2e23e23" returned: 0 in 0.265s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Lock "cinder-quobyte-2357a5e9-a557-4b52-88ce-afa9d2e23e23" released by "delete_volume" :: held 1.516s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Created reservations ['af1d1e90-b85e-433d-8491-5a0233b16eb7', 'f94af8b5-a4d8-44fd-897f-3c899c6194e4', 'db549bbc-90cb-4614-a4f2-7f98a1c3ceae', 'f09f5a5c-2066-489e-ba2d-245bdcb44776'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:47 devstack sudo[115150]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3" returned: 0 in 0.299s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-quobyte-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3" released by "_copy_volume_from_snapshot" :: held 7.251s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:47 devstack sudo[115154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:42:47 devstack sudo[115154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-quobyte-6b65355b-18e2-445c-8398-e4d86024f351-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3" released by "_create_volume_from_snapshot" :: held 7.297s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.332s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.297s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103719431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745e6915-d411-4467-8b29-bf7309df22a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aad89052f5e40a3867af35adc3995ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:41Z,use_quota=True,user_id='9e045da2146f4aa5998d0cc10a5d164c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Creating volume 745e6915-d411-4467-8b29-bf7309df22a9 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:42:47 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-745e6915-d411-4467-8b29-bf7309df22a9 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:47 devstack sudo[115156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-745e6915-d411-4467-8b29-bf7309df22a9 1073741824 Aug 13 09:42:47 devstack sudo[115156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01280ba0-002e-4a9d-b557-fe0494610968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3', 'volume_size': 1, 'snapshot_id': '6b65355b-18e2-445c-8398-e4d86024f351'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503251ea-b427-4c85-a8d4-d93ed791285f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:47 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Volume volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3 (96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3): created successfully Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503251ea-b427-4c85-a8d4-d93ed791285f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Flow 'volume_create_manager' (17d5ef69-3d9a-4623-a2c3-e30b2a0e2b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:47 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-95f46d4d-7a90-4b04-a24d-7d4590c564b2 tempest-VolumeDependencyTests-1518468860 None] Created volume successfully. Aug 13 09:42:47 devstack sudo[115154]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.298s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:42:47 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Deleted volume successfully. Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d53d4e77-f71e-44f4-a7e5-9e333fa23219 tempest-VolumeAndVolumeTypeFromImageTest-1447216655 None] Lock "cinder-2357a5e9-a557-4b52-88ce-afa9d2e23e23-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "cinder-6b65355b-18e2-445c-8398-e4d86024f351-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-6b65355b-18e2-445c-8398-e4d86024f351-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "cinder-quobyte-ba5f361d-c287-4c26-b05d-a841bd89de21" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-quobyte-ba5f361d-c287-4c26-b05d-a841bd89de21" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "cinder-quobyte-6b65355b-18e2-445c-8398-e4d86024f351" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-quobyte-6b65355b-18e2-445c-8398-e4d86024f351" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Deleting offline snapshot 6b65355b-18e2-445c-8398-e4d86024f351 of volume ba5f361d-c287-4c26-b05d-a841bd89de21 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] snapshot_file for this snap is: volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[429b1d98-976a-48ec-a975-0d1484c78d88]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:47 devstack sudo[115156]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-745e6915-d411-4467-8b29-bf7309df22a9 1073741824" returned: 0 in 0.735s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-745e6915-d411-4467-8b29-bf7309df22a9 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:48 devstack sudo[115163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 Aug 13 09:42:48 devstack sudo[115163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:48 devstack sudo[115164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-745e6915-d411-4467-8b29-bf7309df22a9 Aug 13 09:42:48 devstack sudo[115164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:48 devstack sudo[115164]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-745e6915-d411-4467-8b29-bf7309df22a9" returned: 0 in 0.324s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:42:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3efc97-3a7c-4a22-aee3-61219ba464bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-745e6915-d411-4467-8b29-bf7309df22a9', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:48 devstack sudo[115163]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ed7050-cf7c-4106-b963-194e380b627a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351" returned: 0 in 0.579s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:48 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba5f361d-c287-4c26-b05d-a841bd89de21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:42:48 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Volume volume-745e6915-d411-4467-8b29-bf7309df22a9 (745e6915-d411-4467-8b29-bf7309df22a9): created successfully Aug 13 09:42:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ed7050-cf7c-4106-b963-194e380b627a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:48 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Flow 'volume_create_manager' (acded8bd-d9c1-46b1-8913-41fb0af8f728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:48 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b481324-5923-458c-83dc-26d8222ddc60]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:48 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5d89f3c4-e8f1-4148-976b-2cfc06ba8e7c tempest-ProjectReaderTests-552028988 None] Created volume successfully. Aug 13 09:42:48 devstack sudo[115172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 Aug 13 09:42:48 devstack sudo[115172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:48 devstack sudo[115172]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21" returned: 0 in 0.512s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:48 devstack sudo[115178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 Aug 13 09:42:48 devstack sudo[115178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Acquiring lock "cinder-745e6915-d411-4467-8b29-bf7309df22a9-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Lock "cinder-745e6915-d411-4467-8b29-bf7309df22a9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Acquiring lock "cinder-quobyte-745e6915-d411-4467-8b29-bf7309df22a9" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Lock "cinder-quobyte-745e6915-d411-4467-8b29-bf7309df22a9" acquired by "delete_volume" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:49 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2686ad92-44da-45b8-9dce-3384b540a2a8]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-745e6915-d411-4467-8b29-bf7309df22a9 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:49 devstack sudo[115180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-745e6915-d411-4467-8b29-bf7309df22a9 Aug 13 09:42:49 devstack sudo[115180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:49 devstack sudo[115178]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351" returned: 0 in 0.486s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:49 devstack sudo[115185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351 Aug 13 09:42:49 devstack sudo[115185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:49 devstack sudo[115180]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-745e6915-d411-4467-8b29-bf7309df22a9" returned: 0 in 0.554s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-745e6915-d411-4467-8b29-bf7309df22a9 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:49 devstack sudo[115191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-745e6915-d411-4467-8b29-bf7309df22a9 Aug 13 09:42:49 devstack sudo[115191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:49 devstack sudo[115185]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21.6b65355b-18e2-445c-8398-e4d86024f351" returned: 0 in 0.372s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-quobyte-6b65355b-18e2-445c-8398-e4d86024f351" released by "_delete_snapshot" :: held 2.141s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-quobyte-ba5f361d-c287-4c26-b05d-a841bd89de21" released by "delete_snapshot" :: held 2.183s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:49 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Created reservations ['93d3f44d-4060-47e1-8a2f-697d3c21d5bb', '65722257-973d-4cf0-b198-741c1ac4ff6f', '652ee5da-10fb-42e6-86c8-c7d44e91661b', '591ea54a-5711-47f9-add7-e63027afe5be'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:42:50 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Delete snapshot completed successfully. Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21bb06df-657e-4418-b482-43f206db85aa tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-6b65355b-18e2-445c-8398-e4d86024f351-delete_snapshot" released by "delete_snapshot" :: held 2.385s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:50 devstack sudo[115191]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-745e6915-d411-4467-8b29-bf7309df22a9" returned: 0 in 0.375s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Lock "cinder-quobyte-745e6915-d411-4467-8b29-bf7309df22a9" released by "delete_volume" :: held 0.989s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Created reservations ['5f52f6a5-d984-4eef-bd88-b5690221cfe4', '843a0a1b-8384-475e-8544-e210e2e733ee', 'baa97b24-15db-4ed8-bd08-61339829fce5', '81d28161-2143-4c9d-b7c2-83a3cefc633c'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:50 devstack sudo[115196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:42:50 devstack sudo[115196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:50 devstack sudo[115196]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.291s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:42:50 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Deleted volume successfully. Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f75a77b6-17c6-4b90-8e88-ee9356fdfa84 tempest-ProjectReaderTests-552028988 None] Lock "cinder-745e6915-d411-4467-8b29-bf7309df22a9-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Flow 'volume_create_manager' (21983a1f-8251-40c6-8a06-11c691c47479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce00b88-c438-4611-a516-bfa8914bba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "cinder-ba5f361d-c287-4c26-b05d-a841bd89de21-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce00b88-c438-4611-a516-bfa8914bba9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640587639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc74a089-0d78-4101-bf4b-b0ad8d9711bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88ecedbd2d145db8f983313556ac5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:51Z,use_quota=True,user_id='b6bb6980c1b54b54badc43596e24c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de012625-e723-4a78-bda8-c757054c2346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de012625-e723-4a78-bda8-c757054c2346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460612f9-3e9a-45a5-aa1b-edd16f8e8241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460612f9-3e9a-45a5-aa1b-edd16f8e8241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc74a089-0d78-4101-bf4b-b0ad8d9711bb', 'volume_name': 'volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f0fd62-6b61-4345-be28-e1343062ad47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f0fd62-6b61-4345-be28-e1343062ad47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0129c6a4-6448-4567-8518-3385a3ff2bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:51 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume dc74a089-0d78-4101-bf4b-b0ad8d9711bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb', 'volume_size': 1} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640587639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc74a089-0d78-4101-bf4b-b0ad8d9711bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88ecedbd2d145db8f983313556ac5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:51Z,use_quota=True,user_id='b6bb6980c1b54b54badc43596e24c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Creating volume dc74a089-0d78-4101-bf4b-b0ad8d9711bb {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:42:51 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-ba5f361d-c287-4c26-b05d-a841bd89de21-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:51 devstack sudo[115199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb 1073741824 Aug 13 09:42:51 devstack sudo[115199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "cinder-quobyte-ba5f361d-c287-4c26-b05d-a841bd89de21" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-quobyte-ba5f361d-c287-4c26-b05d-a841bd89de21" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[385e4259-ee62-44e0-a482-edf357adc8e7]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:51 devstack sudo[115201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 Aug 13 09:42:51 devstack sudo[115201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:51 devstack sudo[115199]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb 1073741824" returned: 0 in 0.598s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:51 devstack sudo[115201]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21" returned: 0 in 0.502s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:51 devstack sudo[115209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21 Aug 13 09:42:51 devstack sudo[115209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:51 devstack sudo[115211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb Aug 13 09:42:51 devstack sudo[115211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:52 devstack sudo[115211]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Flow 'volume_create_manager' (8085fc9f-66fe-4c92-9de5-2ae57e010fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05ab018-49dc-459c-80fc-8036879fba4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb" returned: 0 in 0.359s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05ab018-49dc-459c-80fc-8036879fba4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144545953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b68832-1b78-44d6-aece-cfadc0e46c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aad89052f5e40a3867af35adc3995ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:52Z,use_quota=True,user_id='9e045da2146f4aa5998d0cc10a5d164c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc9c0d8-556e-41d3-b908-773afff78879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc9c0d8-556e-41d3-b908-773afff78879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187b8504-e7e7-4eb5-a70d-9d5f92bfc8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187b8504-e7e7-4eb5-a70d-9d5f92bfc8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b68832-1b78-44d6-aece-cfadc0e46c99', 'volume_name': 'volume-50b68832-1b78-44d6-aece-cfadc0e46c99', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:52 devstack sudo[115209]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3751fe60-93ad-4cbb-be40-f37181156e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3751fe60-93ad-4cbb-be40-f37181156e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426727da-2666-419b-8913-ca7e4c877920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:52 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Volume 50b68832-1b78-44d6-aece-cfadc0e46c99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b68832-1b78-44d6-aece-cfadc0e46c99', 'volume_size': 1} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144545953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b68832-1b78-44d6-aece-cfadc0e46c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aad89052f5e40a3867af35adc3995ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:52Z,use_quota=True,user_id='9e045da2146f4aa5998d0cc10a5d164c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Creating volume 50b68832-1b78-44d6-aece-cfadc0e46c99 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:42:52 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50b68832-1b78-44d6-aece-cfadc0e46c99 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0129c6a4-6448-4567-8518-3385a3ff2bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c49772a-86cf-4c86-955a-8d53da9917fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ba5f361d-c287-4c26-b05d-a841bd89de21" returned: 0 in 0.486s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:52 devstack sudo[115215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50b68832-1b78-44d6-aece-cfadc0e46c99 1073741824 Aug 13 09:42:52 devstack sudo[115215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-quobyte-ba5f361d-c287-4c26-b05d-a841bd89de21" released by "delete_volume" :: held 1.065s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:52 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb (dc74a089-0d78-4101-bf4b-b0ad8d9711bb): created successfully Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c49772a-86cf-4c86-955a-8d53da9917fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Flow 'volume_create_manager' (21983a1f-8251-40c6-8a06-11c691c47479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:52 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-ad16842c-6a67-4418-9720-b77c1a9562d9 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Created volume successfully. Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Created reservations ['b7f0aef7-8682-4246-a396-a46307c1b11a', '5151c817-b12e-4cc1-b6f8-d65e5c20d317', 'db4df51e-7f7d-4468-9767-6c363e34d74b', 'a307ec97-4955-454a-aee4-1c2caa01800b'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:52 devstack sudo[115217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:42:52 devstack sudo[115217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:52 devstack sudo[115217]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.302s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:42:52 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Deleted volume successfully. Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e154bbc-040a-4682-a78d-522b7aa516a5 tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-ba5f361d-c287-4c26-b05d-a841bd89de21-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:52 devstack sudo[115215]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50b68832-1b78-44d6-aece-cfadc0e46c99 1073741824" returned: 0 in 0.577s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50b68832-1b78-44d6-aece-cfadc0e46c99 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:52 devstack sudo[115224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50b68832-1b78-44d6-aece-cfadc0e46c99 Aug 13 09:42:52 devstack sudo[115224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:53 devstack sudo[115224]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50b68832-1b78-44d6-aece-cfadc0e46c99" returned: 0 in 0.294s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426727da-2666-419b-8913-ca7e4c877920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b68832-1b78-44d6-aece-cfadc0e46c99', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f55489-d891-413b-adb5-70c4dd07f2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:53 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Volume volume-50b68832-1b78-44d6-aece-cfadc0e46c99 (50b68832-1b78-44d6-aece-cfadc0e46c99): created successfully Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f55489-d891-413b-adb5-70c4dd07f2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Flow 'volume_create_manager' (8085fc9f-66fe-4c92-9de5-2ae57e010fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:53 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-28c4fff5-4766-40f2-a3fc-9eaebf486654 tempest-ProjectReaderTests-552028988 None] Created volume successfully. Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] Creating offline snapshot b78baa4d-8e8a-4471-9d5d-32b7fe193d41 of volume dc74a089-0d78-4101-bf4b-b0ad8d9711bb {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae37ebd1-9c97-4556-bfd2-982755584754]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "cinder-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "cinder-quobyte-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-quobyte-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:53 devstack sudo[115227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb Aug 13 09:42:53 devstack sudo[115227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c94970d-d839-4091-a8ca-277163e20d9a]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:53 devstack sudo[115229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3 Aug 13 09:42:53 devstack sudo[115229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:53 devstack sudo[115227]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb" returned: 0 in 0.514s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:53 devstack sudo[115234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41 1G Aug 13 09:42:53 devstack sudo[115234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Flow 'volume_create_manager' (df4895ba-b00e-415d-9ebc-68a47d6bc020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d778b9bd-c8b5-44d2-aa2b-e23f36898b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d778b9bd-c8b5-44d2-aa2b-e23f36898b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281145961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e0b834-c013-4417-94d1-357ca8deaf88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2553d47f05aa4b10a1bd34fccfa14c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:54Z,use_quota=True,user_id='28d9781fd0d44005b26f55563c5421e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575c4960-7f35-4240-81ba-e1e0d1fe5f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575c4960-7f35-4240-81ba-e1e0d1fe5f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684f30b4-5c99-439e-bb12-027b3b339e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684f30b4-5c99-439e-bb12-027b3b339e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e0b834-c013-4417-94d1-357ca8deaf88', 'volume_name': 'volume-86e0b834-c013-4417-94d1-357ca8deaf88', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba303486-0970-45a5-93fc-6a0f0e3efa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba303486-0970-45a5-93fc-6a0f0e3efa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b35f58a-6400-4b6c-affb-eb2e0defbc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:53 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume 86e0b834-c013-4417-94d1-357ca8deaf88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e0b834-c013-4417-94d1-357ca8deaf88', 'volume_size': 1} Aug 13 09:42:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:54 devstack sudo[115229]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3" returned: 0 in 0.470s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:54 devstack sudo[115239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3 Aug 13 09:42:54 devstack sudo[115239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Acquiring lock "cinder-50b68832-1b78-44d6-aece-cfadc0e46c99-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Lock "cinder-50b68832-1b78-44d6-aece-cfadc0e46c99-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Acquiring lock "cinder-quobyte-50b68832-1b78-44d6-aece-cfadc0e46c99" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Lock "cinder-quobyte-50b68832-1b78-44d6-aece-cfadc0e46c99" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0472e6e-31b5-4cc7-ae27-f841046b0be9]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50b68832-1b78-44d6-aece-cfadc0e46c99 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:54 devstack sudo[115239]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3" returned: 0 in 0.279s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-quobyte-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3" released by "delete_volume" :: held 0.794s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:54 devstack sudo[115244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50b68832-1b78-44d6-aece-cfadc0e46c99 Aug 13 09:42:54 devstack sudo[115244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:54 devstack sudo[115234]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41 1G" returned: 0 in 0.513s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Created reservations ['0f6e695f-477a-4580-9ed2-09760e384a29', 'a1390550-c263-43fa-8a39-d0ea2d02e797', '67c9170c-7881-4a4d-b9d9-fd464faf8dcd', 'd2614bd6-59e5-4f1f-a0d8-6fa5691195d3'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:42:54 devstack sudo[115248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41 Aug 13 09:42:54 devstack sudo[115248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:54 devstack sudo[115250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:42:54 devstack sudo[115250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:54 devstack sudo[115244]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50b68832-1b78-44d6-aece-cfadc0e46c99" returned: 0 in 0.445s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50b68832-1b78-44d6-aece-cfadc0e46c99 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:54 devstack sudo[115257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50b68832-1b78-44d6-aece-cfadc0e46c99 Aug 13 09:42:54 devstack sudo[115257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:54 devstack sudo[115250]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.342s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:42:54 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Deleted volume successfully. Aug 13 09:42:54 devstack sudo[115248]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41" returned: 0 in 0.492s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:54 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41 is being set with open permissions: ugo+rw Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e7f24779-fac9-4392-bff4-6830f19766c8 tempest-VolumeDependencyTests-1518468860 None] Lock "cinder-96b8ee6f-ddf7-41dd-a5ed-83c64c84d1d3-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:54 devstack sudo[115262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41 Aug 13 09:42:54 devstack sudo[115262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:54 devstack sudo[115257]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50b68832-1b78-44d6-aece-cfadc0e46c99" returned: 0 in 0.314s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Lock "cinder-quobyte-50b68832-1b78-44d6-aece-cfadc0e46c99" released by "delete_volume" :: held 0.804s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Created reservations ['a23558d8-3c87-477c-be0f-2b7939668258', 'cb195011-352f-41d3-bddd-c8da4bd3331e', 'c2e3e83e-29d5-444e-9519-fa717e78bcf7', 'bce21f73-73c3-4163-8233-f1cb11b41f71'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:42:55 devstack sudo[115262]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41" returned: 0 in 0.303s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:55 devstack sudo[115266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:42:55 devstack sudo[115266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:55 devstack sudo[115268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.info Aug 13 09:42:55 devstack sudo[115268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:55 devstack sudo[115266]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.356s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:42:55 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Deleted volume successfully. Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2be15b1a-72bf-49eb-bcc5-284177aa693f tempest-ProjectReaderTests-552028988 None] Lock "cinder-50b68832-1b78-44d6-aece-cfadc0e46c99-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:42:55 devstack sudo[115268]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.info" returned: 0 in 0.440s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:55 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.info is being set with open permissions: ugo+rw Aug 13 09:42:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:55 devstack sudo[115272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.info Aug 13 09:42:55 devstack sudo[115272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:56 devstack sudo[115272]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.info" returned: 0 in 0.347s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.730s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.061s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281145961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e0b834-c013-4417-94d1-357ca8deaf88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2553d47f05aa4b10a1bd34fccfa14c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:54Z,use_quota=True,user_id='28d9781fd0d44005b26f55563c5421e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:42:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Creating volume 86e0b834-c013-4417-94d1-357ca8deaf88 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:42:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:42:56 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:42:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-86e0b834-c013-4417-94d1-357ca8deaf88 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:56 devstack sudo[115275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-86e0b834-c013-4417-94d1-357ca8deaf88 1073741824 Aug 13 09:42:56 devstack sudo[115275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:56 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b9d4251e-81be-411c-b0b6-5f031a317abf tempest-CreateVolumesFromSnapshotTest-1975462194 None] Create snapshot completed successfully Aug 13 09:42:56 devstack sudo[115275]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-86e0b834-c013-4417-94d1-357ca8deaf88 1073741824" returned: 0 in 0.604s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-86e0b834-c013-4417-94d1-357ca8deaf88 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:56 devstack sudo[115281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-86e0b834-c013-4417-94d1-357ca8deaf88 Aug 13 09:42:56 devstack sudo[115281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:57 devstack sudo[115281]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-86e0b834-c013-4417-94d1-357ca8deaf88" returned: 0 in 0.448s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b35f58a-6400-4b6c-affb-eb2e0defbc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e0b834-c013-4417-94d1-357ca8deaf88', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523102cc-8736-4889-8651-4db357081757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:57 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume volume-86e0b834-c013-4417-94d1-357ca8deaf88 (86e0b834-c013-4417-94d1-357ca8deaf88): created successfully Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523102cc-8736-4889-8651-4db357081757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Flow 'volume_create_manager' (df4895ba-b00e-415d-9ebc-68a47d6bc020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:57 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-8d55f2a7-4101-44fe-91bf-5ddc1b14f4e1 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Created volume successfully. Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Flow 'volume_create_manager' (fc2aa510-dfa2-474f-b5b2-ae2cfc95f3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99afe759-9a7f-4593-9aec-36930435f0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99afe759-9a7f-4593-9aec-36930435f0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-423287718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbd0569-e9fe-4200-a207-74bb47ecb8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88ecedbd2d145db8f983313556ac5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:57Z,use_quota=True,user_id='b6bb6980c1b54b54badc43596e24c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48451216-0ff6-4f06-be36-6074e8697fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48451216-0ff6-4f06-be36-6074e8697fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d4671e-62d8-4423-a723-d3da7f1816f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d4671e-62d8-4423-a723-d3da7f1816f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fbd0569-e9fe-4200-a207-74bb47ecb8be', 'volume_name': 'volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2201cd-8e77-4913-83a1-e38dfae18a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2201cd-8e77-4913-83a1-e38dfae18a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7322eb0e-0db9-4fb6-abb3-12393d49cf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:57 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume 1fbd0569-e9fe-4200-a207-74bb47ecb8be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be', 'volume_size': 1} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-423287718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbd0569-e9fe-4200-a207-74bb47ecb8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88ecedbd2d145db8f983313556ac5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:57Z,use_quota=True,user_id='b6bb6980c1b54b54badc43596e24c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Creating volume 1fbd0569-e9fe-4200-a207-74bb47ecb8be {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:42:57 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:57 devstack sudo[115284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be 1073741824 Aug 13 09:42:57 devstack sudo[115284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Flow 'volume_create_manager' (4a2e7508-6d01-4b04-8513-0b280f891108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30663ec3-c14f-4ca4-9526-fad9e5845460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30663ec3-c14f-4ca4-9526-fad9e5845460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611266928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318ccc7f-4aef-47ed-b652-0cb28676b3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88ecedbd2d145db8f983313556ac5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:58Z,use_quota=True,user_id='b6bb6980c1b54b54badc43596e24c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbd5820-4521-473f-be4d-8715b767b953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbd5820-4521-473f-be4d-8715b767b953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43aa0d23-8553-4168-9c99-677a5bcb36ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43aa0d23-8553-4168-9c99-677a5bcb36ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '318ccc7f-4aef-47ed-b652-0cb28676b3b4', 'volume_name': 'volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a323303-9838-4a43-902a-241e6b6d8395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a323303-9838-4a43-902a-241e6b6d8395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7f078a-6c61-48a1-a16f-d3cea710a1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:57 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume 318ccc7f-4aef-47ed-b652-0cb28676b3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4', 'volume_size': 1} Aug 13 09:42:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:58 devstack sudo[115284]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be 1073741824" returned: 0 in 0.686s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:58 devstack sudo[115291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be Aug 13 09:42:58 devstack sudo[115291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Flow 'volume_create_manager' (97f91be2-20f0-4edc-ba8e-6e2ef1703dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e8c8e9-f4c6-4f89-be23-e856de9aeaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e8c8e9-f4c6-4f89-be23-e856de9aeaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2135662010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b6856a-6ae4-473f-9947-db31c9843750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88ecedbd2d145db8f983313556ac5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:58Z,use_quota=True,user_id='b6bb6980c1b54b54badc43596e24c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5f6ada-0f18-4a49-b306-43ce2dfdf25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5f6ada-0f18-4a49-b306-43ce2dfdf25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62b3e80-f067-4565-a981-3370a50e274f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62b3e80-f067-4565-a981-3370a50e274f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4b6856a-6ae4-473f-9947-db31c9843750', 'volume_name': 'volume-c4b6856a-6ae4-473f-9947-db31c9843750', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912611a2-24c5-4020-bc91-bdb98cd28a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912611a2-24c5-4020-bc91-bdb98cd28a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da0b817e-ea85-4e70-b3c3-32393845c9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:58 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume c4b6856a-6ae4-473f-9947-db31c9843750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4b6856a-6ae4-473f-9947-db31c9843750', 'volume_size': 1} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:58 devstack sudo[115291]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be" returned: 0 in 0.573s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.869s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611266928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318ccc7f-4aef-47ed-b652-0cb28676b3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88ecedbd2d145db8f983313556ac5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:58Z,use_quota=True,user_id='b6bb6980c1b54b54badc43596e24c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Creating volume 318ccc7f-4aef-47ed-b652-0cb28676b3b4 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:42:58 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7322eb0e-0db9-4fb6-abb3-12393d49cf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:58 devstack sudo[115294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4 1073741824 Aug 13 09:42:58 devstack sudo[115294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c9e94c-0063-4f48-a81c-be819d08261f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:58 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be (1fbd0569-e9fe-4200-a207-74bb47ecb8be): created successfully Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c9e94c-0063-4f48-a81c-be819d08261f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:58 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Flow 'volume_create_manager' (fc2aa510-dfa2-474f-b5b2-ae2cfc95f3a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:59 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-a7da06c5-404a-4d07-a08e-01f1a7c5139a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Created volume successfully. Aug 13 09:42:59 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:42:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Flow 'volume_create_manager' (276c368b-ed4c-4211-8ba3-bf39711485de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:42:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ef4517-49e4-4609-9a86-9e651a9e2dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ef4517-49e4-4609-9a86-9e651a9e2dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-30883178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effdd539-add2-4247-812a-9f2e72ed89f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88ecedbd2d145db8f983313556ac5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:59Z,use_quota=True,user_id='b6bb6980c1b54b54badc43596e24c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec62e449-1af8-46f0-ab16-2b4457e42301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec62e449-1af8-46f0-ab16-2b4457e42301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:59 devstack sudo[115294]: pam_unix(sudo:session): session closed for user root Aug 13 09:42:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfa8499-ba3e-46f1-9aca-ae9f9731b7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfa8499-ba3e-46f1-9aca-ae9f9731b7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'effdd539-add2-4247-812a-9f2e72ed89f7', 'volume_name': 'volume-effdd539-add2-4247-812a-9f2e72ed89f7', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b187cbe-9bf2-4c8b-a489-fc7b0b877aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b187cbe-9bf2-4c8b-a489-fc7b0b877aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:42:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011da83d-16a5-48cb-a895-623b9923c205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:42:59 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume effdd539-add2-4247-812a-9f2e72ed89f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-effdd539-add2-4247-812a-9f2e72ed89f7', 'volume_size': 1} Aug 13 09:42:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:42:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4 1073741824" returned: 0 in 0.895s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:42:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:42:59 devstack sudo[115300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4 Aug 13 09:42:59 devstack sudo[115300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:00 devstack sudo[115300]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4" returned: 0 in 0.437s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.484s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2135662010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b6856a-6ae4-473f-9947-db31c9843750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88ecedbd2d145db8f983313556ac5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:58Z,use_quota=True,user_id='b6bb6980c1b54b54badc43596e24c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Creating volume c4b6856a-6ae4-473f-9947-db31c9843750 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:00 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c4b6856a-6ae4-473f-9947-db31c9843750 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:00 devstack sudo[115306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c4b6856a-6ae4-473f-9947-db31c9843750 1073741824 Aug 13 09:43:00 devstack sudo[115306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7f078a-6c61-48a1-a16f-d3cea710a1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d223285-6498-43f1-aa25-e1adba3e8ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Flow 'volume_create_manager' (a66218ca-8767-45a8-8e11-9f263d3e1489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f09e0a5-1fa9-4c74-84d0-c7e83b310947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:00 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4 (318ccc7f-4aef-47ed-b652-0cb28676b3b4): created successfully Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d223285-6498-43f1-aa25-e1adba3e8ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Flow 'volume_create_manager' (4a2e7508-6d01-4b04-8513-0b280f891108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f09e0a5-1fa9-4c74-84d0-c7e83b310947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1714469966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7764cd4-8047-4533-a53a-b38e1eeab48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2553d47f05aa4b10a1bd34fccfa14c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:00Z,use_quota=True,user_id='28d9781fd0d44005b26f55563c5421e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8f8316-4245-4380-abb5-5b0ea472f8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8f8316-4245-4380-abb5-5b0ea472f8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426c0546-25fb-482f-971c-2da064fa036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426c0546-25fb-482f-971c-2da064fa036a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7764cd4-8047-4533-a53a-b38e1eeab48d', 'volume_name': 'volume-c7764cd4-8047-4533-a53a-b38e1eeab48d', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130345e2-b479-42cc-8029-b37178f834ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130345e2-b479-42cc-8029-b37178f834ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feeea0eb-0adc-49aa-8698-fdff7b6c9067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:00 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume c7764cd4-8047-4533-a53a-b38e1eeab48d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7764cd4-8047-4533-a53a-b38e1eeab48d', 'volume_size': 1} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:00 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-7ddbca5c-1bbe-454c-88d2-74a6d5ea303e tempest-CreateVolumesFromSnapshotTest-1975462194 None] Created volume successfully. Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Flow 'volume_create_manager' (bd169fc9-a269-4501-9373-5c52dd41915f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507299bf-97fc-49f3-834f-965b00a5dd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507299bf-97fc-49f3-834f-965b00a5dd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-988520633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c338fc-317c-4104-a328-7535f804be74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88ecedbd2d145db8f983313556ac5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:00Z,use_quota=True,user_id='b6bb6980c1b54b54badc43596e24c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050d80bb-00b0-4450-9b66-e9e7c729cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050d80bb-00b0-4450-9b66-e9e7c729cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28735f18-b39f-4bc4-97e8-f5e1af4652e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28735f18-b39f-4bc4-97e8-f5e1af4652e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1c338fc-317c-4104-a328-7535f804be74', 'volume_name': 'volume-a1c338fc-317c-4104-a328-7535f804be74', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8e822b-dfca-4995-a342-7d84f266ebf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8e822b-dfca-4995-a342-7d84f266ebf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc5d77e-7e9d-4a7b-8094-84f085b25038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:00 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume a1c338fc-317c-4104-a328-7535f804be74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1c338fc-317c-4104-a328-7535f804be74', 'volume_size': 1} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Flow 'volume_create_manager' (2800ba65-b001-4c01-81e0-9af861f14fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3dbd3a8-6ed3-4497-8558-b1cca5fed613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack sudo[115306]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3dbd3a8-6ed3-4497-8558-b1cca5fed613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-369699034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878957dd-5e0d-4455-a252-2e9955567208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2553d47f05aa4b10a1bd34fccfa14c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:00Z,use_quota=True,user_id='28d9781fd0d44005b26f55563c5421e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad0b9f8-46bb-49cc-a8cc-9f7995297546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad0b9f8-46bb-49cc-a8cc-9f7995297546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a687c2a4-127a-471a-b031-700648e08d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a687c2a4-127a-471a-b031-700648e08d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '878957dd-5e0d-4455-a252-2e9955567208', 'volume_name': 'volume-878957dd-5e0d-4455-a252-2e9955567208', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a72c77-718f-4bbc-96a3-9db875b6db68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a72c77-718f-4bbc-96a3-9db875b6db68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a43ea5-2583-4393-8ee9-b8027a6f264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume 878957dd-5e0d-4455-a252-2e9955567208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-878957dd-5e0d-4455-a252-2e9955567208', 'volume_size': 1} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c4b6856a-6ae4-473f-9947-db31c9843750 1073741824" returned: 0 in 0.914s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Flow 'volume_create_manager' (b6f38c15-c386-40d2-a991-9d771ccb3123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4bca43-7159-475f-9f65-469bd0c2b928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c4b6856a-6ae4-473f-9947-db31c9843750 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4bca43-7159-475f-9f65-469bd0c2b928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1959353902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12007ca-2fff-4156-96d8-f959c6f519c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2553d47f05aa4b10a1bd34fccfa14c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:01Z,use_quota=True,user_id='28d9781fd0d44005b26f55563c5421e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f845904-8d25-4ba9-bc40-b00ab3ff9578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f845904-8d25-4ba9-bc40-b00ab3ff9578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58bfe14f-f3da-4d3c-873c-59096983ded1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58bfe14f-f3da-4d3c-873c-59096983ded1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b12007ca-2fff-4156-96d8-f959c6f519c0', 'volume_name': 'volume-b12007ca-2fff-4156-96d8-f959c6f519c0', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:01 devstack sudo[115314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c4b6856a-6ae4-473f-9947-db31c9843750 Aug 13 09:43:01 devstack sudo[115314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c49eaba-b725-4d3f-8977-d96cfd7bf193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c49eaba-b725-4d3f-8977-d96cfd7bf193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe73a70-fd95-45a4-afd7-c4e35ee1c500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume b12007ca-2fff-4156-96d8-f959c6f519c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b12007ca-2fff-4156-96d8-f959c6f519c0', 'volume_size': 1} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Flow 'volume_create_manager' (fc060bb7-c9a7-4a56-abc9-4fb5ddf97486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c275456b-eb2a-4d20-96b8-16c1e31b7bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c275456b-eb2a-4d20-96b8-16c1e31b7bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1251361585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77883511-3573-4329-a9d3-9bf6d9c15616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2553d47f05aa4b10a1bd34fccfa14c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:01Z,use_quota=True,user_id='28d9781fd0d44005b26f55563c5421e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b87dfb5-4707-4516-af13-64da842e2c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b87dfb5-4707-4516-af13-64da842e2c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b79b456-3f64-41c8-8fd5-08d795080031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b79b456-3f64-41c8-8fd5-08d795080031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77883511-3573-4329-a9d3-9bf6d9c15616', 'volume_name': 'volume-77883511-3573-4329-a9d3-9bf6d9c15616', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dc5ce3-c8fe-408b-b5e1-bb56cbd07190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dc5ce3-c8fe-408b-b5e1-bb56cbd07190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7582d6-c6f9-417e-9847-4febe3c75ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume 77883511-3573-4329-a9d3-9bf6d9c15616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77883511-3573-4329-a9d3-9bf6d9c15616', 'volume_size': 1} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:01 devstack sudo[115314]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c4b6856a-6ae4-473f-9947-db31c9843750" returned: 0 in 0.435s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.998s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-30883178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effdd539-add2-4247-812a-9f2e72ed89f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88ecedbd2d145db8f983313556ac5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:42:59Z,use_quota=True,user_id='b6bb6980c1b54b54badc43596e24c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Creating volume effdd539-add2-4247-812a-9f2e72ed89f7 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:01 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-effdd539-add2-4247-812a-9f2e72ed89f7 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da0b817e-ea85-4e70-b3c3-32393845c9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4b6856a-6ae4-473f-9947-db31c9843750', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:01 devstack sudo[115317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-effdd539-add2-4247-812a-9f2e72ed89f7 1073741824 Aug 13 09:43:01 devstack sudo[115317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e291c22-1543-44da-99a1-d1a59b65ee4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:01 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume volume-c4b6856a-6ae4-473f-9947-db31c9843750 (c4b6856a-6ae4-473f-9947-db31c9843750): created successfully Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e291c22-1543-44da-99a1-d1a59b65ee4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Flow 'volume_create_manager' (97f91be2-20f0-4edc-ba8e-6e2ef1703dd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:01 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c2361a09-8d23-4307-a0be-af67be4e9645 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Created volume successfully. Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Flow 'volume_create_manager' (c0d4aa76-9e1a-452d-a79a-bdf04fd6077a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed0f4a8-0509-4a6a-88e1-4ba4f9a47f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed0f4a8-0509-4a6a-88e1-4ba4f9a47f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-246812880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5739ddc-9a73-458e-a258-575938accacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2553d47f05aa4b10a1bd34fccfa14c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:02Z,use_quota=True,user_id='28d9781fd0d44005b26f55563c5421e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc56323-475d-4307-a5d2-f8ab0ec54777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc56323-475d-4307-a5d2-f8ab0ec54777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:02 devstack sudo[115317]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3975b761-9293-4863-86dd-9f9e821f6fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3975b761-9293-4863-86dd-9f9e821f6fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5739ddc-9a73-458e-a258-575938accacd', 'volume_name': 'volume-c5739ddc-9a73-458e-a258-575938accacd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e18f15-63c6-4b2b-83f4-40908e0eb075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e18f15-63c6-4b2b-83f4-40908e0eb075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a15155-160f-4c24-b74c-36bcf988baf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:02 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume c5739ddc-9a73-458e-a258-575938accacd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5739ddc-9a73-458e-a258-575938accacd', 'volume_size': 1} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Flow 'volume_create_manager' (9c9328d2-0909-4c73-8aa5-8c76c203d7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d0c14b-ef98-4c82-a2f8-67128d03ef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-effdd539-add2-4247-812a-9f2e72ed89f7 1073741824" returned: 0 in 0.754s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d0c14b-ef98-4c82-a2f8-67128d03ef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-19711610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862f95e7-2b0c-433d-bde6-45de494935ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef869c954b4909aa2881532ea78c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:02Z,use_quota=True,user_id='203c22f10abb49a3a6c7430c20fe0c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b83ff9b-b683-491c-b98d-9a4f04c7b912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b83ff9b-b683-491c-b98d-9a4f04c7b912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbdb8e49-409a-4693-9d5b-0924484c7944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbdb8e49-409a-4693-9d5b-0924484c7944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '862f95e7-2b0c-433d-bde6-45de494935ea', 'volume_name': 'volume-862f95e7-2b0c-433d-bde6-45de494935ea', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c086801-c429-407e-bd63-85bcf1a62911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c086801-c429-407e-bd63-85bcf1a62911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d4489d-81a9-4fa4-99a3-fe0072e80727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:02 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Volume 862f95e7-2b0c-433d-bde6-45de494935ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-862f95e7-2b0c-433d-bde6-45de494935ea', 'volume_size': 1} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-effdd539-add2-4247-812a-9f2e72ed89f7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:02 devstack sudo[115322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-effdd539-add2-4247-812a-9f2e72ed89f7 Aug 13 09:43:02 devstack sudo[115322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:02 devstack sudo[115322]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-effdd539-add2-4247-812a-9f2e72ed89f7" returned: 0 in 0.271s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.238s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1714469966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7764cd4-8047-4533-a53a-b38e1eeab48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2553d47f05aa4b10a1bd34fccfa14c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:00Z,use_quota=True,user_id='28d9781fd0d44005b26f55563c5421e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Creating volume c7764cd4-8047-4533-a53a-b38e1eeab48d {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:02 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c7764cd4-8047-4533-a53a-b38e1eeab48d 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011da83d-16a5-48cb-a895-623b9923c205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-effdd539-add2-4247-812a-9f2e72ed89f7', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0b0b60-3ebb-4703-aadc-0190fe5b80ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:02 devstack sudo[115325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c7764cd4-8047-4533-a53a-b38e1eeab48d 1073741824 Aug 13 09:43:02 devstack sudo[115325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:02 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume volume-effdd539-add2-4247-812a-9f2e72ed89f7 (effdd539-add2-4247-812a-9f2e72ed89f7): created successfully Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0b0b60-3ebb-4703-aadc-0190fe5b80ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:02 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Flow 'volume_create_manager' (276c368b-ed4c-4211-8ba3-bf39711485de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:02 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-520bc8a8-cfad-4e51-afd6-aca40f715bc4 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Created volume successfully. Aug 13 09:43:03 devstack sudo[115325]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c7764cd4-8047-4533-a53a-b38e1eeab48d 1073741824" returned: 0 in 0.503s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c7764cd4-8047-4533-a53a-b38e1eeab48d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:03 devstack sudo[115331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c7764cd4-8047-4533-a53a-b38e1eeab48d Aug 13 09:43:03 devstack sudo[115331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:03 devstack sudo[115331]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c7764cd4-8047-4533-a53a-b38e1eeab48d" returned: 0 in 0.302s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.757s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-988520633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c338fc-317c-4104-a328-7535f804be74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88ecedbd2d145db8f983313556ac5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:00Z,use_quota=True,user_id='b6bb6980c1b54b54badc43596e24c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Creating volume a1c338fc-317c-4104-a328-7535f804be74 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:03 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a1c338fc-317c-4104-a328-7535f804be74 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:03 devstack sudo[115334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a1c338fc-317c-4104-a328-7535f804be74 1073741824 Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feeea0eb-0adc-49aa-8698-fdff7b6c9067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7764cd4-8047-4533-a53a-b38e1eeab48d', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:03 devstack sudo[115334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b6056e-7ca7-4aa8-bdae-9056022e9157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:03 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume volume-c7764cd4-8047-4533-a53a-b38e1eeab48d (c7764cd4-8047-4533-a53a-b38e1eeab48d): created successfully Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b6056e-7ca7-4aa8-bdae-9056022e9157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Flow 'volume_create_manager' (a66218ca-8767-45a8-8e11-9f263d3e1489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:03 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-cd4116b6-de7a-49e0-a3a4-68b05d8ee706 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Created volume successfully. Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Flow 'volume_create_manager' (3e5d7765-bc85-4b57-b014-bc228cef81a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6a7395-ef34-4653-9977-b8ef418d642b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6a7395-ef34-4653-9977-b8ef418d642b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b3af98-f9a4-4413-8e2f-e31f330ff69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5fe293ba6c443aca28d6768bda2b320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:04Z,use_quota=True,user_id='170736cd8d41426e9a5adf44684bd2df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe12170-55b2-4f53-8ece-dec039ef51fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe12170-55b2-4f53-8ece-dec039ef51fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3750b6a5-c064-48a1-a692-6be0b5787317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:03 devstack cinder-volume[94670]: DEBUG cinder.image.glance [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Creating Keystone auth plugin from conf {{(pid=94670) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3750b6a5-c064-48a1-a692-6be0b5787317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b1b3af98-f9a4-4413-8e2f-e31f330ff69f', 'volume_name': 'volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f', 'volume_size': 1, 'image_id': '5453dfcc-c8ae-4096-aac9-97e20946917b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5453dfcc-c8ae-4096-aac9-97e20946917b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63c74085d691a27c8d803da6966bdcbb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd5fe293ba6c443aca28d6768bda2b320', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f7c7fecec2d45cc20656e728dc11f38c42c9d258ba437915828ebfb9e646538dd1efb0e592d4ec93b132b3efc7159ebc2521a007c2542f4c062eb3397d74c9ec', 'id': '5453dfcc-c8ae-4096-aac9-97e20946917b', 'created_at': datetime.datetime(2026, 8, 13, 7, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5453dfcc-c8ae-4096-aac9-97e20946917b/file', 'properties': {}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1339b140-5438-43d1-bcb8-500d6819b3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1339b140-5438-43d1-bcb8-500d6819b3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e0d931-8659-40cd-ab48-f1effbfd7bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:04 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Volume b1b3af98-f9a4-4413-8e2f-e31f330ff69f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f', 'volume_size': 1, 'image_id': '5453dfcc-c8ae-4096-aac9-97e20946917b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5453dfcc-c8ae-4096-aac9-97e20946917b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63c74085d691a27c8d803da6966bdcbb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd5fe293ba6c443aca28d6768bda2b320', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f7c7fecec2d45cc20656e728dc11f38c42c9d258ba437915828ebfb9e646538dd1efb0e592d4ec93b132b3efc7159ebc2521a007c2542f4c062eb3397d74c9ec', 'id': '5453dfcc-c8ae-4096-aac9-97e20946917b', 'created_at': datetime.datetime(2026, 8, 13, 7, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5453dfcc-c8ae-4096-aac9-97e20946917b/file', 'properties': {}}, 'image_service': } Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Trying to clone b1b3af98-f9a4-4413-8e2f-e31f330ff69f from image 5453dfcc-c8ae-4096-aac9-97e20946917b at location (None, [{'url': 'file:///opt/stack/data/glance/images/5453dfcc-c8ae-4096-aac9-97e20946917b', 'metadata': {}}]). {{(pid=94670) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 13 09:43:04 devstack sudo[115334]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 13 09:43:04 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Image download 0.00 MB at 0.00 MB/s Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a1c338fc-317c-4104-a328-7535f804be74 1073741824" returned: 0 in 0.592s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a1c338fc-317c-4104-a328-7535f804be74 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa66ce7-9916-4f3c-a46a-86e2d0386d07]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:04 devstack sudo[115341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a1c338fc-317c-4104-a328-7535f804be74 Aug 13 09:43:04 devstack sudo[115341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:04 devstack sudo[115342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD Aug 13 09:43:04 devstack sudo[115342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:04 devstack sudo[115341]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a1c338fc-317c-4104-a328-7535f804be74" returned: 0 in 0.266s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.453s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-369699034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878957dd-5e0d-4455-a252-2e9955567208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2553d47f05aa4b10a1bd34fccfa14c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:00Z,use_quota=True,user_id='28d9781fd0d44005b26f55563c5421e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Creating volume 878957dd-5e0d-4455-a252-2e9955567208 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:04 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-878957dd-5e0d-4455-a252-2e9955567208 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:04 devstack sudo[115346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-878957dd-5e0d-4455-a252-2e9955567208 1073741824 Aug 13 09:43:04 devstack sudo[115346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc5d77e-7e9d-4a7b-8094-84f085b25038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1c338fc-317c-4104-a328-7535f804be74', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6eaaf2-83c6-4e15-8855-4deb61ad56db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:04 devstack sudo[115342]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:04 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Volume volume-a1c338fc-317c-4104-a328-7535f804be74 (a1c338fc-317c-4104-a328-7535f804be74): created successfully Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6eaaf2-83c6-4e15-8855-4deb61ad56db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Flow 'volume_create_manager' (bd169fc9-a269-4501-9373-5c52dd41915f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:04 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-4d65f377-242d-45f6-b6bd-f84f4f7197fb tempest-CreateVolumesFromSnapshotTest-1975462194 None] Created volume successfully. Aug 13 09:43:04 devstack sudo[115350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD Aug 13 09:43:04 devstack sudo[115350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:05 devstack sudo[115350]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Temporary image 5453dfcc-c8ae-4096-aac9-97e20946917b is fetched for user 170736cd8d41426e9a5adf44684bd2df. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 13 09:43:05 devstack sudo[115346]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-878957dd-5e0d-4455-a252-2e9955567208 1073741824" returned: 0 in 0.516s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-878957dd-5e0d-4455-a252-2e9955567208 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fb95d8-485a-473e-8d19-e83406c33059]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:05 devstack sudo[115358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-878957dd-5e0d-4455-a252-2e9955567208 Aug 13 09:43:05 devstack sudo[115358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:05 devstack sudo[115359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD Aug 13 09:43:05 devstack sudo[115359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "cinder-a1c338fc-317c-4104-a328-7535f804be74-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-a1c338fc-317c-4104-a328-7535f804be74-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:05 devstack sudo[115358]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-878957dd-5e0d-4455-a252-2e9955567208" returned: 0 in 0.326s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.292s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1959353902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12007ca-2fff-4156-96d8-f959c6f519c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2553d47f05aa4b10a1bd34fccfa14c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:01Z,use_quota=True,user_id='28d9781fd0d44005b26f55563c5421e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Creating volume b12007ca-2fff-4156-96d8-f959c6f519c0 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:05 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b12007ca-2fff-4156-96d8-f959c6f519c0 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "cinder-quobyte-a1c338fc-317c-4104-a328-7535f804be74" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:05 devstack sudo[115363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b12007ca-2fff-4156-96d8-f959c6f519c0 1073741824 Aug 13 09:43:05 devstack sudo[115363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a43ea5-2583-4393-8ee9-b8027a6f264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-878957dd-5e0d-4455-a252-2e9955567208', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae01d163-a0a1-4653-b2af-0bdf0e913b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-a1c338fc-317c-4104-a328-7535f804be74" acquired by "delete_volume" :: waited 0.043s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:05 devstack sudo[115359]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:05 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume volume-878957dd-5e0d-4455-a252-2e9955567208 (878957dd-5e0d-4455-a252-2e9955567208): created successfully Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae01d163-a0a1-4653-b2af-0bdf0e913b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Flow 'volume_create_manager' (2800ba65-b001-4c01-81e0-9af861f14fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c93cce-9938-4f23-b867-d7e2d6dc8001]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a1c338fc-317c-4104-a328-7535f804be74 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:05 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b9c0ef22-9d16-4f7f-9ada-d4b1c99d9757 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Created volume successfully. Aug 13 09:43:05 devstack sudo[115368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a1c338fc-317c-4104-a328-7535f804be74 Aug 13 09:43:05 devstack sudo[115368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:05 devstack sudo[115367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD Aug 13 09:43:05 devstack sudo[115367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:06 devstack sudo[115367]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD" returned: 1 in 0.404s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:06 devstack sudo[115368]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a1c338fc-317c-4104-a328-7535f804be74" returned: 0 in 0.403s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a1c338fc-317c-4104-a328-7535f804be74 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:06 devstack sudo[115363]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b12007ca-2fff-4156-96d8-f959c6f519c0 1073741824" returned: 0 in 0.539s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:06 devstack sudo[115380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a1c338fc-317c-4104-a328-7535f804be74 Aug 13 09:43:06 devstack sudo[115380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b12007ca-2fff-4156-96d8-f959c6f519c0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:06 devstack sudo[115382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b12007ca-2fff-4156-96d8-f959c6f519c0 Aug 13 09:43:06 devstack sudo[115382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:06 devstack sudo[115380]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-a1c338fc-317c-4104-a328-7535f804be74" returned: 0 in 0.296s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-a1c338fc-317c-4104-a328-7535f804be74" released by "delete_volume" :: held 0.763s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:06 devstack sudo[115382]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b12007ca-2fff-4156-96d8-f959c6f519c0" returned: 0 in 0.276s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.828s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1251361585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77883511-3573-4329-a9d3-9bf6d9c15616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2553d47f05aa4b10a1bd34fccfa14c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:01Z,use_quota=True,user_id='28d9781fd0d44005b26f55563c5421e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Creating volume 77883511-3573-4329-a9d3-9bf6d9c15616 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:06 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77883511-3573-4329-a9d3-9bf6d9c15616 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe73a70-fd95-45a4-afd7-c4e35ee1c500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b12007ca-2fff-4156-96d8-f959c6f519c0', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:06 devstack sudo[115386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77883511-3573-4329-a9d3-9bf6d9c15616 1073741824 Aug 13 09:43:06 devstack sudo[115386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cb0547-2325-40cc-a144-d4bcd5ffe037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:06 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume volume-b12007ca-2fff-4156-96d8-f959c6f519c0 (b12007ca-2fff-4156-96d8-f959c6f519c0): created successfully Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cb0547-2325-40cc-a144-d4bcd5ffe037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Flow 'volume_create_manager' (b6f38c15-c386-40d2-a991-9d771ccb3123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:06 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-ce3195c7-e49e-4f8d-9416-21abc97e451b tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Created volume successfully. Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Created reservations ['e92a0d07-0485-40e4-977c-f2de977ef4aa', '86386c76-3e4a-4d4d-87b5-ac6255150ffd', '77524b79-b6f2-4117-8890-b73aa4724229', '25411d4e-81c2-4e71-8117-98acf69d0fd2'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:06 devstack sudo[115388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:06 devstack sudo[115388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "cinder-effdd539-add2-4247-812a-9f2e72ed89f7-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-effdd539-add2-4247-812a-9f2e72ed89f7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "cinder-quobyte-effdd539-add2-4247-812a-9f2e72ed89f7" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-effdd539-add2-4247-812a-9f2e72ed89f7" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[650c8a9a-c0d9-415d-ab12-7ee0a026f7ae]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-effdd539-add2-4247-812a-9f2e72ed89f7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:06 devstack sudo[115388]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.330s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:06 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Deleted volume successfully. Aug 13 09:43:06 devstack sudo[115393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-effdd539-add2-4247-812a-9f2e72ed89f7 Aug 13 09:43:06 devstack sudo[115393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f1c2ff61-31ae-449e-b481-d351994cc7c7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-a1c338fc-317c-4104-a328-7535f804be74-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:07 devstack sudo[115386]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77883511-3573-4329-a9d3-9bf6d9c15616 1073741824" returned: 0 in 0.577s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77883511-3573-4329-a9d3-9bf6d9c15616 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:07 devstack sudo[115397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77883511-3573-4329-a9d3-9bf6d9c15616 Aug 13 09:43:07 devstack sudo[115397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:07 devstack sudo[115393]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-effdd539-add2-4247-812a-9f2e72ed89f7" returned: 0 in 0.405s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-effdd539-add2-4247-812a-9f2e72ed89f7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:07 devstack sudo[115402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-effdd539-add2-4247-812a-9f2e72ed89f7 Aug 13 09:43:07 devstack sudo[115402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:07 devstack sudo[115397]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77883511-3573-4329-a9d3-9bf6d9c15616" returned: 0 in 0.289s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.931s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-246812880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5739ddc-9a73-458e-a258-575938accacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2553d47f05aa4b10a1bd34fccfa14c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:02Z,use_quota=True,user_id='28d9781fd0d44005b26f55563c5421e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Creating volume c5739ddc-9a73-458e-a258-575938accacd {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:07 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c5739ddc-9a73-458e-a258-575938accacd 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7582d6-c6f9-417e-9847-4febe3c75ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77883511-3573-4329-a9d3-9bf6d9c15616', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531d15be-56ec-498e-a6ef-d2fcdfd1daa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:07 devstack sudo[115405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c5739ddc-9a73-458e-a258-575938accacd 1073741824 Aug 13 09:43:07 devstack sudo[115405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:07 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume volume-77883511-3573-4329-a9d3-9bf6d9c15616 (77883511-3573-4329-a9d3-9bf6d9c15616): created successfully Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531d15be-56ec-498e-a6ef-d2fcdfd1daa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Flow 'volume_create_manager' (fc060bb7-c9a7-4a56-abc9-4fb5ddf97486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:07 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-431236bc-2758-4886-b8fe-e66995d34e94 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Created volume successfully. Aug 13 09:43:07 devstack sudo[115402]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-effdd539-add2-4247-812a-9f2e72ed89f7" returned: 0 in 0.336s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-effdd539-add2-4247-812a-9f2e72ed89f7" released by "delete_volume" :: held 0.787s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Created reservations ['e016d2e9-e886-4e03-9f95-d5bdc8ffd12e', 'f1bcc979-fc79-4ec2-b024-a15b0100d8ce', 'a2e24354-81f0-4a58-968e-aa8e50c3b3f2', 'ea070fca-7542-4885-8113-dc038f2ad449'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:07 devstack sudo[115411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:07 devstack sudo[115411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:07 devstack sudo[115405]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c5739ddc-9a73-458e-a258-575938accacd 1073741824" returned: 0 in 0.560s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "cinder-c4b6856a-6ae4-473f-9947-db31c9843750-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-c4b6856a-6ae4-473f-9947-db31c9843750-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c5739ddc-9a73-458e-a258-575938accacd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:08 devstack sudo[115411]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.335s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:08 devstack sudo[115415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c5739ddc-9a73-458e-a258-575938accacd Aug 13 09:43:08 devstack sudo[115415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:08 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Deleted volume successfully. Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "cinder-quobyte-c4b6856a-6ae4-473f-9947-db31c9843750" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c51e42be-2f2f-4f43-9797-974314517939 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-effdd539-add2-4247-812a-9f2e72ed89f7-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-c4b6856a-6ae4-473f-9947-db31c9843750" acquired by "delete_volume" :: waited 0.020s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbc1548-d892-435f-8c4a-f63647136702]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c4b6856a-6ae4-473f-9947-db31c9843750 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:08 devstack sudo[115417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c4b6856a-6ae4-473f-9947-db31c9843750 Aug 13 09:43:08 devstack sudo[115417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:08 devstack sudo[115415]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c5739ddc-9a73-458e-a258-575938accacd" returned: 0 in 0.265s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.772s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-19711610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862f95e7-2b0c-433d-bde6-45de494935ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef869c954b4909aa2881532ea78c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:02Z,use_quota=True,user_id='203c22f10abb49a3a6c7430c20fe0c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Creating volume 862f95e7-2b0c-433d-bde6-45de494935ea {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:08 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-862f95e7-2b0c-433d-bde6-45de494935ea 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a15155-160f-4c24-b74c-36bcf988baf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5739ddc-9a73-458e-a258-575938accacd', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc518f4-e33b-4583-b0bf-21fd85bf1821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:08 devstack sudo[115420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-862f95e7-2b0c-433d-bde6-45de494935ea 1073741824 Aug 13 09:43:08 devstack sudo[115420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:08 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Volume volume-c5739ddc-9a73-458e-a258-575938accacd (c5739ddc-9a73-458e-a258-575938accacd): created successfully Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc518f4-e33b-4583-b0bf-21fd85bf1821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Flow 'volume_create_manager' (c0d4aa76-9e1a-452d-a79a-bdf04fd6077a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:08 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-78c0f97b-a414-40a7-9466-103e8f7a0674 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Created volume successfully. Aug 13 09:43:08 devstack sudo[115417]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c4b6856a-6ae4-473f-9947-db31c9843750" returned: 0 in 0.431s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c4b6856a-6ae4-473f-9947-db31c9843750 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:08 devstack sudo[115426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c4b6856a-6ae4-473f-9947-db31c9843750 Aug 13 09:43:08 devstack sudo[115426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "cinder-c5739ddc-9a73-458e-a258-575938accacd-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-c5739ddc-9a73-458e-a258-575938accacd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:08 devstack sudo[115420]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:08 devstack sudo[115426]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c4b6856a-6ae4-473f-9947-db31c9843750" returned: 0 in 0.314s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "cinder-quobyte-c5739ddc-9a73-458e-a258-575938accacd" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-862f95e7-2b0c-433d-bde6-45de494935ea 1073741824" returned: 0 in 0.591s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-c4b6856a-6ae4-473f-9947-db31c9843750" released by "delete_volume" :: held 0.799s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-quobyte-c5739ddc-9a73-458e-a258-575938accacd" acquired by "delete_volume" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f2a496-8770-4fab-9cfe-f9f2e24c2f59]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c5739ddc-9a73-458e-a258-575938accacd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-862f95e7-2b0c-433d-bde6-45de494935ea {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:08 devstack sudo[115433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-862f95e7-2b0c-433d-bde6-45de494935ea Aug 13 09:43:08 devstack sudo[115433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Created reservations ['7b8fc5e3-46ba-494d-bcaf-26790640da9e', 'd89ec7d2-03fb-493f-a658-9f95776deb50', 'f538906a-0243-42c4-bd7b-407e8bbb664e', 'fe3c3f34-2c3f-48e4-9b35-192f519b4103'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:09 devstack sudo[115432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c5739ddc-9a73-458e-a258-575938accacd Aug 13 09:43:09 devstack sudo[115432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:09 devstack sudo[115436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:09 devstack sudo[115436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "cinder-318ccc7f-4aef-47ed-b652-0cb28676b3b4-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-318ccc7f-4aef-47ed-b652-0cb28676b3b4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "cinder-quobyte-318ccc7f-4aef-47ed-b652-0cb28676b3b4" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-318ccc7f-4aef-47ed-b652-0cb28676b3b4" acquired by "delete_volume" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:09 devstack sudo[115433]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-862f95e7-2b0c-433d-bde6-45de494935ea" returned: 0 in 0.374s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aed5a09-435f-4b57-b052-ca09d49d3ec3]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.257s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b3af98-f9a4-4413-8e2f-e31f330ff69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5fe293ba6c443aca28d6768bda2b320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:04Z,use_quota=True,user_id='170736cd8d41426e9a5adf44684bd2df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Creating volume b1b3af98-f9a4-4413-8e2f-e31f330ff69f {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:09 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:09 devstack sudo[115432]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:09 devstack sudo[115442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f 1073741824 Aug 13 09:43:09 devstack sudo[115442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c5739ddc-9a73-458e-a258-575938accacd" returned: 0 in 0.456s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c5739ddc-9a73-458e-a258-575938accacd {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d4489d-81a9-4fa4-99a3-fe0072e80727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-862f95e7-2b0c-433d-bde6-45de494935ea', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61aa734-d3ab-498e-94a3-05cbc7ed887d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:09 devstack sudo[115445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c5739ddc-9a73-458e-a258-575938accacd Aug 13 09:43:09 devstack sudo[115445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:09 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Volume volume-862f95e7-2b0c-433d-bde6-45de494935ea (862f95e7-2b0c-433d-bde6-45de494935ea): created successfully Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61aa734-d3ab-498e-94a3-05cbc7ed887d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Flow 'volume_create_manager' (9c9328d2-0909-4c73-8aa5-8c76c203d7a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:09 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c90e28d1-acf2-459e-8008-e729f08b2c33 tempest-ProjectReaderTests-683284509 None] Created volume successfully. Aug 13 09:43:09 devstack sudo[115436]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:09 devstack sudo[115443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4 Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.388s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:09 devstack sudo[115443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:09 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Deleted volume successfully. Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ee7108f1-9f77-4fe9-b799-fa2322b5b27a tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-c4b6856a-6ae4-473f-9947-db31c9843750-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:09 devstack sudo[115445]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c5739ddc-9a73-458e-a258-575938accacd" returned: 0 in 0.349s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-quobyte-c5739ddc-9a73-458e-a258-575938accacd" released by "delete_volume" :: held 0.853s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Created reservations ['d6e10a34-74da-4631-87e6-c406aa0a5be6', '910661a6-7ea3-4cdc-8298-f7ea7df75777', '8d669d08-b14c-4ceb-9a65-af9f45bf9769', '50c2b686-4ffe-406e-81dd-9f1d9021de29'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:09 devstack sudo[115443]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Acquiring lock "cinder-862f95e7-2b0c-433d-bde6-45de494935ea-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4" returned: 0 in 0.579s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:09 devstack sudo[115457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:09 devstack sudo[115457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:10 devstack sudo[115458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4 Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Lock "cinder-862f95e7-2b0c-433d-bde6-45de494935ea-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:10 devstack sudo[115458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:10 devstack sudo[115442]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f 1073741824" returned: 0 in 0.652s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "cinder-77883511-3573-4329-a9d3-9bf6d9c15616-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-77883511-3573-4329-a9d3-9bf6d9c15616-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Acquiring lock "cinder-quobyte-862f95e7-2b0c-433d-bde6-45de494935ea" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:10 devstack sudo[115461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f Aug 13 09:43:10 devstack sudo[115461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "cinder-quobyte-77883511-3573-4329-a9d3-9bf6d9c15616" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Lock "cinder-quobyte-862f95e7-2b0c-433d-bde6-45de494935ea" acquired by "delete_volume" :: waited 0.061s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-quobyte-77883511-3573-4329-a9d3-9bf6d9c15616" acquired by "delete_volume" :: waited 0.048s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[07465ff9-b2e5-4c6e-9fe4-e4f40bef40f9]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-862f95e7-2b0c-433d-bde6-45de494935ea {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c809a9e-5336-4064-832f-e3b3622ca949]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77883511-3573-4329-a9d3-9bf6d9c15616 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:10 devstack sudo[115458]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-318ccc7f-4aef-47ed-b652-0cb28676b3b4" returned: 0 in 0.385s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:10 devstack sudo[115457]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-318ccc7f-4aef-47ed-b652-0cb28676b3b4" released by "delete_volume" :: held 1.051s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.453s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:10 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Deleted volume successfully. Aug 13 09:43:10 devstack sudo[115466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77883511-3573-4329-a9d3-9bf6d9c15616 Aug 13 09:43:10 devstack sudo[115466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:10 devstack sudo[115465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-862f95e7-2b0c-433d-bde6-45de494935ea Aug 13 09:43:10 devstack sudo[115465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-99b0ee1c-d416-4ea4-a02b-7d5326552d83 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-c5739ddc-9a73-458e-a258-575938accacd-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:10 devstack sudo[115461]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f" returned: 0 in 0.386s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Created reservations ['551f7f50-2961-4430-94af-a4eddb779dfe', '2af12237-6e55-4c36-8c95-0783d7c3fc2a', 'd94ade63-9570-46e2-979a-2dcf7351e466', '1b11a89d-e555-4c32-a243-4ed954abb742'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Attempting download of 5453dfcc-c8ae-4096-aac9-97e20946917b ((None, [{'url': 'file:///opt/stack/data/glance/images/5453dfcc-c8ae-4096-aac9-97e20946917b', 'metadata': {}}])) to volume b1b3af98-f9a4-4413-8e2f-e31f330ff69f. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3645612d-a5b8-45f6-b50f-05578428142e]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5453dfcc-c8ae-4096-aac9-97e20946917b_8wwek_lq {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:10 devstack sudo[115466]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77883511-3573-4329-a9d3-9bf6d9c15616" returned: 0 in 0.477s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77883511-3573-4329-a9d3-9bf6d9c15616 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:10 devstack sudo[115465]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:10 devstack sudo[115478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-862f95e7-2b0c-433d-bde6-45de494935ea" returned: 0 in 0.528s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:10 devstack sudo[115478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-862f95e7-2b0c-433d-bde6-45de494935ea {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:10 devstack sudo[115479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77883511-3573-4329-a9d3-9bf6d9c15616 Aug 13 09:43:10 devstack sudo[115479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:10 devstack sudo[115482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-862f95e7-2b0c-433d-bde6-45de494935ea Aug 13 09:43:10 devstack sudo[115482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:10 devstack sudo[115477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5453dfcc-c8ae-4096-aac9-97e20946917b_8wwek_lq Aug 13 09:43:10 devstack sudo[115477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:11 devstack sudo[115478]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.309s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:11 devstack sudo[115479]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-77883511-3573-4329-a9d3-9bf6d9c15616" returned: 0 in 0.309s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:11 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Deleted volume successfully. Aug 13 09:43:11 devstack sudo[115482]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-quobyte-77883511-3573-4329-a9d3-9bf6d9c15616" released by "delete_volume" :: held 0.858s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-862f95e7-2b0c-433d-bde6-45de494935ea" returned: 0 in 0.308s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Lock "cinder-quobyte-862f95e7-2b0c-433d-bde6-45de494935ea" released by "delete_volume" :: held 0.925s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b0e773ae-66c7-4c37-b316-79272c7e8428 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-318ccc7f-4aef-47ed-b652-0cb28676b3b4-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:11 devstack sudo[115477]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5453dfcc-c8ae-4096-aac9-97e20946917b_8wwek_lq" returned: 0 in 0.429s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5453dfcc-c8ae-4096-aac9-97e20946917b_8wwek_lq {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Created reservations ['d1bf1e0b-a28d-4f88-9c19-a2a861eaeccf', 'd222b0a2-1254-4172-bd3f-da9d116389a3', 'e7d3fbc6-e7d6-4d30-8c46-bbe9404cb19e', '55dad7e3-d100-40fe-9582-e2bc2e06e55b'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Created reservations ['e6668b04-ce22-4dcd-bfa7-193f21550f30', '58e19ed8-7eed-41da-bbeb-62d8a3442bad', '5e0079e1-315c-453a-8019-e52ca229ba42', 'ccdf233a-0a69-45c8-b5d2-11cde9fae7f4'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:11 devstack sudo[115490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5453dfcc-c8ae-4096-aac9-97e20946917b_8wwek_lq Aug 13 09:43:11 devstack sudo[115490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:11 devstack sudo[115492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:11 devstack sudo[115492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:11 devstack sudo[115494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:11 devstack sudo[115494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:11 devstack sudo[115490]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5453dfcc-c8ae-4096-aac9-97e20946917b_8wwek_lq" returned: 1 in 0.371s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5453dfcc-c8ae-4096-aac9-97e20946917b_8wwek_lq' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbc3ec8-0cda-41c5-837d-28eba5fe577a]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "cinder-1fbd0569-e9fe-4200-a207-74bb47ecb8be-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-1fbd0569-e9fe-4200-a207-74bb47ecb8be-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:11 devstack sudo[115492]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.340s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:11 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Deleted volume successfully. Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "cinder-quobyte-1fbd0569-e9fe-4200-a207-74bb47ecb8be" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:11 devstack sudo[115494]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.318s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:11 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Deleted volume successfully. Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-8e9942a7-8fd3-4e25-a561-28e23878b174 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-77883511-3573-4329-a9d3-9bf6d9c15616-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-1fbd0569-e9fe-4200-a207-74bb47ecb8be" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:11 devstack sudo[115498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD Aug 13 09:43:11 devstack sudo[115498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-560b5a5a-516a-44a5-b739-30227419bdc1 tempest-ProjectReaderTests-683284509 None] Lock "cinder-862f95e7-2b0c-433d-bde6-45de494935ea-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[428b9163-bbee-40a5-9ce9-0ffb134d6b00]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:11 devstack sudo[115502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be Aug 13 09:43:11 devstack sudo[115502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:11 devstack sudo[115498]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:12 devstack sudo[115506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD Aug 13 09:43:12 devstack sudo[115506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:12 devstack sudo[115502]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be" returned: 0 in 0.380s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:12 devstack sudo[115511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be Aug 13 09:43:12 devstack sudo[115511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "cinder-b12007ca-2fff-4156-96d8-f959c6f519c0-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:12 devstack sudo[115506]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] 5453dfcc-c8ae-4096-aac9-97e20946917b was raw, converting to raw {{(pid=94670) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-b12007ca-2fff-4156-96d8-f959c6f519c0-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:12 devstack sudo[115516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f Aug 13 09:43:12 devstack sudo[115516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:12 devstack sudo[115511]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1fbd0569-e9fe-4200-a207-74bb47ecb8be" returned: 0 in 0.327s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "cinder-quobyte-b12007ca-2fff-4156-96d8-f959c6f519c0" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-1fbd0569-e9fe-4200-a207-74bb47ecb8be" released by "delete_volume" :: held 0.768s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-quobyte-b12007ca-2fff-4156-96d8-f959c6f519c0" acquired by "delete_volume" :: waited 0.035s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fc7335-1f75-48fe-bbe9-73729244ce64]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b12007ca-2fff-4156-96d8-f959c6f519c0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Created reservations ['92e57fd4-6187-4ec1-aae7-0f450e6c27b0', '9e89dc2d-8073-4946-aac3-8385913ce89b', '6857d816-4f65-4ca0-8eb0-f55552d8664d', '5a1094f3-0637-4627-b2d5-d7d7602d33dc'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:12 devstack sudo[115519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b12007ca-2fff-4156-96d8-f959c6f519c0 Aug 13 09:43:12 devstack sudo[115519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:12 devstack sudo[115522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:12 devstack sudo[115522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Flow 'volume_create_manager' (4408ab8c-f82c-458c-aee1-6c3bf89c10de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95f726d-bd2d-4e75-8f4a-fdb053597385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "cinder-b78baa4d-8e8a-4471-9d5d-32b7fe193d41-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95f726d-bd2d-4e75-8f4a-fdb053597385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-924681488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860c7095-b642-46f0-9a93-702748bf5885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef869c954b4909aa2881532ea78c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:13Z,use_quota=True,user_id='203c22f10abb49a3a6c7430c20fe0c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb487fc1-7905-41cc-aefb-da59e00b44d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb487fc1-7905-41cc-aefb-da59e00b44d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ddb8c5-b753-4e60-89b1-e2c9d037fe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ddb8c5-b753-4e60-89b1-e2c9d037fe3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '860c7095-b642-46f0-9a93-702748bf5885', 'volume_name': 'volume-860c7095-b642-46f0-9a93-702748bf5885', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2580ff0b-2da3-4771-95db-fe37445e3c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:12 devstack sudo[115516]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2580ff0b-2da3-4771-95db-fe37445e3c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0233c86a-1b25-445d-9bfd-c763f3652c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:12 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Volume 860c7095-b642-46f0-9a93-702748bf5885: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-860c7095-b642-46f0-9a93-702748bf5885', 'volume_size': 1} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-924681488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860c7095-b642-46f0-9a93-702748bf5885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef869c954b4909aa2881532ea78c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:13Z,use_quota=True,user_id='203c22f10abb49a3a6c7430c20fe0c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Creating volume 860c7095-b642-46f0-9a93-702748bf5885 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:12 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-860c7095-b642-46f0-9a93-702748bf5885 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f" returned: 0 in 0.614s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5453dfcc-c8ae-4096-aac9-97e20946917b_8fpphhxrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:43:12 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Converted 0.00 MB image at 0.00 MB/s Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-b78baa4d-8e8a-4471-9d5d-32b7fe193d41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.126s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "cinder-quobyte-dc74a089-0d78-4101-bf4b-b0ad8d9711bb" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:13 devstack sudo[115527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f 1G Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-dc74a089-0d78-4101-bf4b-b0ad8d9711bb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "cinder-quobyte-b78baa4d-8e8a-4471-9d5d-32b7fe193d41" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:13 devstack sudo[115527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:13 devstack sudo[115526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-860c7095-b642-46f0-9a93-702748bf5885 1073741824 Aug 13 09:43:13 devstack sudo[115526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-b78baa4d-8e8a-4471-9d5d-32b7fe193d41" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Deleting offline snapshot b78baa4d-8e8a-4471-9d5d-32b7fe193d41 of volume dc74a089-0d78-4101-bf4b-b0ad8d9711bb {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] snapshot_file for this snap is: volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d73b40-0d86-4668-99f9-ed767345fb50]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:13 devstack sudo[115522]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.404s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:13 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Deleted volume successfully. Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-dd9dd776-7238-4ed0-8cc4-1ff6db14511d tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-1fbd0569-e9fe-4200-a207-74bb47ecb8be-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:13 devstack sudo[115519]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b12007ca-2fff-4156-96d8-f959c6f519c0" returned: 0 in 0.636s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b12007ca-2fff-4156-96d8-f959c6f519c0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:13 devstack sudo[115534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41 Aug 13 09:43:13 devstack sudo[115534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:13 devstack sudo[115535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b12007ca-2fff-4156-96d8-f959c6f519c0 Aug 13 09:43:13 devstack sudo[115535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:13 devstack sudo[115527]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f 1G" returned: 0 in 0.399s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2488d603-d45e-428e-a65e-f42f489fe942]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:13 devstack sudo[115535]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b12007ca-2fff-4156-96d8-f959c6f519c0" returned: 0 in 0.334s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-quobyte-b12007ca-2fff-4156-96d8-f959c6f519c0" released by "delete_volume" :: held 1.055s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:13 devstack sudo[115534]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41" returned: 0 in 0.480s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:43:13 devstack sudo[115544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f Aug 13 09:43:13 devstack sudo[115544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d9f828-eaca-4528-862d-a7329ceaccf5]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:13 devstack sudo[115526]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-860c7095-b642-46f0-9a93-702748bf5885 1073741824" returned: 0 in 0.707s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Created reservations ['7be94753-a7e5-494f-83d8-1941a0838303', 'b6034ad0-b941-4cf0-a6fe-aae3b461162f', '5822895d-988d-4014-82a6-be1e50767039', '29b537a3-2b54-4dae-8a78-e563d2bfbec9'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-860c7095-b642-46f0-9a93-702748bf5885 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:13 devstack sudo[115550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb Aug 13 09:43:13 devstack sudo[115550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:13 devstack sudo[115551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-860c7095-b642-46f0-9a93-702748bf5885 Aug 13 09:43:13 devstack sudo[115551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:13 devstack sudo[115556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:13 devstack sudo[115556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:13 devstack sudo[115544]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f" returned: 0 in 0.491s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:14 devstack sudo[115551]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-860c7095-b642-46f0-9a93-702748bf5885" returned: 0 in 0.309s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:14 devstack sudo[115558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:14 devstack sudo[115558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0233c86a-1b25-445d-9bfd-c763f3652c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-860c7095-b642-46f0-9a93-702748bf5885', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca063ea0-21d2-4633-a974-47984367e5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:14 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Volume volume-860c7095-b642-46f0-9a93-702748bf5885 (860c7095-b642-46f0-9a93-702748bf5885): created successfully Aug 13 09:43:14 devstack sudo[115550]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca063ea0-21d2-4633-a974-47984367e5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Flow 'volume_create_manager' (4408ab8c-f82c-458c-aee1-6c3bf89c10de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb" returned: 0 in 0.494s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:14 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-12b34fa1-5347-4368-9ac2-274d32daf3fb tempest-ProjectReaderTests-683284509 None] Created volume successfully. Aug 13 09:43:14 devstack sudo[115565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41 Aug 13 09:43:14 devstack sudo[115565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:14 devstack sudo[115556]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.333s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:14 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Deleted volume successfully. Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-208c1867-a4cf-44aa-9fc0-adbeb30032ad tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-b12007ca-2fff-4156-96d8-f959c6f519c0-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:14 devstack sudo[115558]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f" returned: 1 in 0.425s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Downloaded image 5453dfcc-c8ae-4096-aac9-97e20946917b ((None, [{'url': 'file:///opt/stack/data/glance/images/5453dfcc-c8ae-4096-aac9-97e20946917b', 'metadata': {}}])) to volume b1b3af98-f9a4-4413-8e2f-e31f330ff69f successfully. {{(pid=94670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Temporary image 5453dfcc-c8ae-4096-aac9-97e20946917b for user 170736cd8d41426e9a5adf44684bd2df is deleted. {{(pid=94670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.volume.volume_utils [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Marking volume b1b3af98-f9a4-4413-8e2f-e31f330ff69f as bootable. {{(pid=94670) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Copying metadata from image 5453dfcc-c8ae-4096-aac9-97e20946917b to b1b3af98-f9a4-4413-8e2f-e31f330ff69f. {{(pid=94670) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Creating volume glance metadata for volume b1b3af98-f9a4-4413-8e2f-e31f330ff69f backed by image 5453dfcc-c8ae-4096-aac9-97e20946917b with: {'image_id': '5453dfcc-c8ae-4096-aac9-97e20946917b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '63c74085d691a27c8d803da6966bdcbb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94670) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e0d931-8659-40cd-ab48-f1effbfd7bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f', 'volume_size': 1, 'image_id': '5453dfcc-c8ae-4096-aac9-97e20946917b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5453dfcc-c8ae-4096-aac9-97e20946917b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63c74085d691a27c8d803da6966bdcbb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd5fe293ba6c443aca28d6768bda2b320', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f7c7fecec2d45cc20656e728dc11f38c42c9d258ba437915828ebfb9e646538dd1efb0e592d4ec93b132b3efc7159ebc2521a007c2542f4c062eb3397d74c9ec', 'id': '5453dfcc-c8ae-4096-aac9-97e20946917b', 'created_at': datetime.datetime(2026, 8, 13, 7, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 13, 7, 43, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5453dfcc-c8ae-4096-aac9-97e20946917b/file', 'properties': {}}, 'image_service': }' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd692f4d-0f5f-4556-be54-8105c416966e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:14 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Volume volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f (b1b3af98-f9a4-4413-8e2f-e31f330ff69f): created successfully Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd692f4d-0f5f-4556-be54-8105c416966e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Flow 'volume_create_manager' (3e5d7765-bc85-4b57-b014-bc228cef81a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:14 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-4224c8bf-1e6e-442a-b3d8-256b71596920 tempest-VolumeImageDependencyTests-1123021380 None] Created volume successfully. Aug 13 09:43:14 devstack sudo[115565]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41" returned: 0 in 0.406s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:14 devstack sudo[115573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41 Aug 13 09:43:14 devstack sudo[115573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "cinder-878957dd-5e0d-4455-a252-2e9955567208-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-878957dd-5e0d-4455-a252-2e9955567208-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "cinder-quobyte-878957dd-5e0d-4455-a252-2e9955567208" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-quobyte-878957dd-5e0d-4455-a252-2e9955567208" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad42b52-8105-47fb-a224-715b5a2f72ad]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-878957dd-5e0d-4455-a252-2e9955567208 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Acquiring lock "cinder-b1b3af98-f9a4-4413-8e2f-e31f330ff69f-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Lock "cinder-b1b3af98-f9a4-4413-8e2f-e31f330ff69f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:14 devstack sudo[115573]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Acquiring lock "cinder-860c7095-b642-46f0-9a93-702748bf5885-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb.b78baa4d-8e8a-4471-9d5d-32b7fe193d41" returned: 0 in 0.431s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Acquiring lock "cinder-quobyte-b1b3af98-f9a4-4413-8e2f-e31f330ff69f" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:14 devstack sudo[115575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-878957dd-5e0d-4455-a252-2e9955567208 Aug 13 09:43:14 devstack sudo[115575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Lock "cinder-quobyte-b1b3af98-f9a4-4413-8e2f-e31f330ff69f" acquired by "delete_volume" :: waited 0.059s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Lock "cinder-860c7095-b642-46f0-9a93-702748bf5885-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-b78baa4d-8e8a-4471-9d5d-32b7fe193d41" released by "_delete_snapshot" :: held 2.009s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-dc74a089-0d78-4101-bf4b-b0ad8d9711bb" released by "delete_snapshot" :: held 2.045s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f465834-b5df-4a48-89f1-90f8f2aeb016]: (4, 'raw') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Acquiring lock "cinder-quobyte-860c7095-b642-46f0-9a93-702748bf5885" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Lock "cinder-quobyte-860c7095-b642-46f0-9a93-702748bf5885" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efb78aa-4317-4d6f-be1e-da54a58ded67]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-860c7095-b642-46f0-9a93-702748bf5885 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Created reservations ['180fb144-c947-42a9-8229-ccdc37d01902', '74d21a95-7723-4776-99c6-c612c7ef6b78', 'efee53ae-4597-4a48-81da-7264cc62e5d4', '45d1f32f-20f0-48f0-bfa7-848dee264c3c'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:15 devstack sudo[115578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f Aug 13 09:43:15 devstack sudo[115578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:15 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Delete snapshot completed successfully. Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-00e70ea1-13ce-4b38-a8d3-3de35286c2a7 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-b78baa4d-8e8a-4471-9d5d-32b7fe193d41-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:15 devstack sudo[115575]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-878957dd-5e0d-4455-a252-2e9955567208" returned: 0 in 0.512s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-878957dd-5e0d-4455-a252-2e9955567208 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:15 devstack sudo[115579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-860c7095-b642-46f0-9a93-702748bf5885 Aug 13 09:43:15 devstack sudo[115584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-878957dd-5e0d-4455-a252-2e9955567208 Aug 13 09:43:15 devstack sudo[115579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:15 devstack sudo[115584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:15 devstack sudo[115578]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f" returned: 0 in 0.399s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:15 devstack sudo[115579]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-860c7095-b642-46f0-9a93-702748bf5885" returned: 0 in 0.437s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-860c7095-b642-46f0-9a93-702748bf5885 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:15 devstack sudo[115589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f Aug 13 09:43:15 devstack sudo[115589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:15 devstack sudo[115584]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-878957dd-5e0d-4455-a252-2e9955567208" returned: 0 in 0.310s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:15 devstack sudo[115596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-860c7095-b642-46f0-9a93-702748bf5885 Aug 13 09:43:15 devstack sudo[115596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-quobyte-878957dd-5e0d-4455-a252-2e9955567208" released by "delete_volume" :: held 0.900s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Created reservations ['3de27f8a-e674-4bf5-8598-2ea0597e1766', 'e7579f6e-0974-4ea9-9bce-bff26d5f6a9d', '6a4b032c-8320-4ebf-87da-f7d943018479', 'cc5f7190-9372-45d1-a4f2-fe6e555a410b'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:15 devstack sudo[115598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:15 devstack sudo[115598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:15 devstack sudo[115596]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-860c7095-b642-46f0-9a93-702748bf5885" returned: 0 in 0.284s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:15 devstack sudo[115589]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f" returned: 1 in 0.417s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f' failed. Not Retrying. {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Lock "cinder-quobyte-860c7095-b642-46f0-9a93-702748bf5885" released by "delete_volume" :: held 0.785s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:15 devstack sudo[115604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f Aug 13 09:43:15 devstack sudo[115604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:15 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Created reservations ['d7144a3c-4702-4ec0-8263-25340e543a25', '90b34c36-5847-4593-b6e5-72fa4122867d', '905389ad-0a34-4bd6-9117-56b5dd37eb6c', '6de56b59-d367-4edf-82ab-c5ee644c527c'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:16 devstack sudo[115598]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.328s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:16 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Deleted volume successfully. Aug 13 09:43:16 devstack sudo[115607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:16 devstack sudo[115607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-c3f9027d-c7fa-406f-a073-676d1a85e435 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-878957dd-5e0d-4455-a252-2e9955567208-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "cinder-dc74a089-0d78-4101-bf4b-b0ad8d9711bb-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-dc74a089-0d78-4101-bf4b-b0ad8d9711bb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:16 devstack sudo[115604]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b1b3af98-f9a4-4413-8e2f-e31f330ff69f" returned: 0 in 0.364s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Lock "cinder-quobyte-b1b3af98-f9a4-4413-8e2f-e31f330ff69f" released by "delete_volume" :: held 1.289s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "cinder-quobyte-dc74a089-0d78-4101-bf4b-b0ad8d9711bb" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-dc74a089-0d78-4101-bf4b-b0ad8d9711bb" acquired by "delete_volume" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c868e2-7205-4641-9eef-635e14922896]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Created reservations ['3a12f2dd-2df3-45b4-8d5b-4d190c836b20', 'fab05433-872f-4155-8134-b2816c8a2589', '3131ce6f-2f12-4eef-8a21-b0afd8331a51', 'a5d41023-b668-48be-9b26-154ee8189ece'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:16 devstack sudo[115607]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.342s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:16 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Deleted volume successfully. Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-3c596245-294a-4550-a43e-f9c6b8fe81a7 tempest-ProjectReaderTests-683284509 None] Lock "cinder-860c7095-b642-46f0-9a93-702748bf5885-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:16 devstack sudo[115612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:16 devstack sudo[115610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb Aug 13 09:43:16 devstack sudo[115610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:16 devstack sudo[115612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:16 devstack sudo[115612]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.283s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:16 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Deleted volume successfully. Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-805bb515-2d80-492f-98bc-d378e3bda96d tempest-VolumeImageDependencyTests-1123021380 None] Lock "cinder-b1b3af98-f9a4-4413-8e2f-e31f330ff69f-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "cinder-c7764cd4-8047-4533-a53a-b38e1eeab48d-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:16 devstack sudo[115610]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb" returned: 0 in 0.516s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:16 devstack sudo[115619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb Aug 13 09:43:16 devstack sudo[115619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Flow 'volume_create_manager' (83eb1c7a-82cc-4b96-a3b1-2fa5135d329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351d4f62-593e-4564-8c67-39921898c40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-c7764cd4-8047-4533-a53a-b38e1eeab48d-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351d4f62-593e-4564-8c67-39921898c40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303528677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17dc8cf6-4ca1-468a-b6c4-64e31e92bf99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef869c954b4909aa2881532ea78c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:17Z,use_quota=True,user_id='203c22f10abb49a3a6c7430c20fe0c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed56b11a-4e1d-4b0b-87b2-fbc489760752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed56b11a-4e1d-4b0b-87b2-fbc489760752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638947d2-5fdb-4d8d-8f36-2505e9f70409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638947d2-5fdb-4d8d-8f36-2505e9f70409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17dc8cf6-4ca1-468a-b6c4-64e31e92bf99', 'volume_name': 'volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ed6808-fccf-4375-9f6b-159967ff43de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ed6808-fccf-4375-9f6b-159967ff43de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b03747-0c92-4919-8ebb-f8ed40e22ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:17 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Volume 17dc8cf6-4ca1-468a-b6c4-64e31e92bf99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99', 'volume_size': 1} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303528677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17dc8cf6-4ca1-468a-b6c4-64e31e92bf99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef869c954b4909aa2881532ea78c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:17Z,use_quota=True,user_id='203c22f10abb49a3a6c7430c20fe0c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Creating volume 17dc8cf6-4ca1-468a-b6c4-64e31e92bf99 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:17 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:17 devstack sudo[115621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99 1073741824 Aug 13 09:43:17 devstack sudo[115621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "cinder-quobyte-c7764cd4-8047-4533-a53a-b38e1eeab48d" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-quobyte-c7764cd4-8047-4533-a53a-b38e1eeab48d" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eb0991-eddc-4f34-adf8-a84102d441d9]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c7764cd4-8047-4533-a53a-b38e1eeab48d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:17 devstack sudo[115619]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-dc74a089-0d78-4101-bf4b-b0ad8d9711bb" returned: 0 in 0.326s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-quobyte-dc74a089-0d78-4101-bf4b-b0ad8d9711bb" released by "delete_volume" :: held 0.908s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:17 devstack sudo[115623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c7764cd4-8047-4533-a53a-b38e1eeab48d Aug 13 09:43:17 devstack sudo[115623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Created reservations ['fd552af5-3e82-4a81-a420-7317224d2d2c', '21b0d423-6556-44af-b06b-9415de26e1e8', '6687e891-e2ba-4808-b0d0-4d197ee6e27f', '2c2e424f-878b-4f24-98b6-3ff54f3d709d'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:17 devstack sudo[115629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:17 devstack sudo[115629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:17 devstack sudo[115623]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c7764cd4-8047-4533-a53a-b38e1eeab48d" returned: 0 in 0.519s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c7764cd4-8047-4533-a53a-b38e1eeab48d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:17 devstack sudo[115634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c7764cd4-8047-4533-a53a-b38e1eeab48d Aug 13 09:43:17 devstack sudo[115634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:17 devstack sudo[115621]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99 1073741824" returned: 0 in 0.718s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:17 devstack sudo[115629]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.407s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:17 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Deleted volume successfully. Aug 13 09:43:17 devstack sudo[115637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99 Aug 13 09:43:17 devstack sudo[115637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4c923e80-2d39-430b-bd05-3ef0f72d6348 tempest-CreateVolumesFromSnapshotTest-1975462194 None] Lock "cinder-dc74a089-0d78-4101-bf4b-b0ad8d9711bb-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:18 devstack sudo[115634]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c7764cd4-8047-4533-a53a-b38e1eeab48d" returned: 0 in 0.363s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-quobyte-c7764cd4-8047-4533-a53a-b38e1eeab48d" released by "delete_volume" :: held 0.967s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Created reservations ['1fbec2ac-ed4f-49a0-9a73-6d62ccbe519d', '294e2119-258a-4a6f-a161-7d8370228452', 'b6a168b7-41ff-4499-8adf-815fc5657082', 'fa463d17-5bb8-4ea7-a7f2-070f938babd1'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:18 devstack sudo[115637]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99" returned: 0 in 0.338s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b03747-0c92-4919-8ebb-f8ed40e22ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb90e23-1f76-4625-9c35-40092ae635dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:18 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Volume volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99 (17dc8cf6-4ca1-468a-b6c4-64e31e92bf99): created successfully Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb90e23-1f76-4625-9c35-40092ae635dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Flow 'volume_create_manager' (83eb1c7a-82cc-4b96-a3b1-2fa5135d329f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:18 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-070b0533-b9a2-4370-a55c-4cdb721fc9da tempest-ProjectReaderTests-683284509 None] Created volume successfully. Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:18 devstack sudo[115641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:18 devstack sudo[115641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:18 devstack sudo[115641]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.283s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:18 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Deleted volume successfully. Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-27e42abc-e2ba-4a35-a26b-1fc858708574 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-c7764cd4-8047-4533-a53a-b38e1eeab48d-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:18 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Acquiring lock "cinder-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Lock "cinder-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Acquiring lock "cinder-quobyte-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Lock "cinder-quobyte-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99" acquired by "delete_volume" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:19 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3388da-1043-4920-b3ee-ee491cf9f941]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "cinder-86e0b834-c013-4417-94d1-357ca8deaf88-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-86e0b834-c013-4417-94d1-357ca8deaf88-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "cinder-quobyte-86e0b834-c013-4417-94d1-357ca8deaf88" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-quobyte-86e0b834-c013-4417-94d1-357ca8deaf88" acquired by "delete_volume" :: waited 0.033s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:19 devstack sudo[115646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99 Aug 13 09:43:19 devstack sudo[115646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:19 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a372a66-7900-4f67-9948-b4f64ba86a7b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-86e0b834-c013-4417-94d1-357ca8deaf88 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:19 devstack sudo[115648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-86e0b834-c013-4417-94d1-357ca8deaf88 Aug 13 09:43:19 devstack sudo[115648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:19 devstack sudo[115646]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99" returned: 0 in 0.599s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:19 devstack sudo[115655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99 Aug 13 09:43:19 devstack sudo[115655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:19 devstack sudo[115648]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-86e0b834-c013-4417-94d1-357ca8deaf88" returned: 0 in 0.473s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-86e0b834-c013-4417-94d1-357ca8deaf88 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:19 devstack sudo[115658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-86e0b834-c013-4417-94d1-357ca8deaf88 Aug 13 09:43:19 devstack sudo[115658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:20 devstack sudo[115658]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:20 devstack sudo[115655]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99" returned: 0 in 0.380s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-86e0b834-c013-4417-94d1-357ca8deaf88" returned: 0 in 0.313s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Lock "cinder-quobyte-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99" released by "delete_volume" :: held 1.058s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-quobyte-86e0b834-c013-4417-94d1-357ca8deaf88" released by "delete_volume" :: held 0.853s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Created reservations ['6b33e8f4-9393-42d6-8cc8-932a73a8d843', '65ac76dc-d766-4523-953f-336558da12b7', '0bc00ec0-d6b0-437d-84dc-cc8d1e990f2a', '06d65a26-49ea-486e-a5c6-c0e7e459e886'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Created reservations ['24d7f301-d129-4089-a774-1ac801269761', '714a6c1f-fe0a-46d4-a05d-c22e8024cbe0', '9f467af0-f617-47d7-93fd-21654b6fc236', 'b3446d09-5faa-49dd-bfce-ca9c16151a62'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:20 devstack sudo[115664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:20 devstack sudo[115664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:20 devstack sudo[115666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:20 devstack sudo[115666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:20 devstack sudo[115664]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.331s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:20 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Deleted volume successfully. Aug 13 09:43:20 devstack sudo[115666]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.296s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:20 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Deleted volume successfully. Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-ef05d55e-a97f-4dbc-9938-2c99f965dc46 tempest-CreateVolumesFromSourceVolumeTest-1392759145 None] Lock "cinder-86e0b834-c013-4417-94d1-357ca8deaf88-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-f68a4680-95e4-4a55-be28-a774300d0496 tempest-ProjectReaderTests-683284509 None] Lock "cinder-17dc8cf6-4ca1-468a-b6c4-64e31e92bf99-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Flow 'volume_create_manager' (6c165461-8cc7-4bdc-b367-9b740138de45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4aa03d5-395f-41c5-9416-b3f257419eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4aa03d5-395f-41c5-9416-b3f257419eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86f9710-1f6f-45f2-a722-bf0b6305d89e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffefa9b108049b7a5d2382ac26bfdda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:22Z,use_quota=True,user_id='1ebc3e6f309c4b3b85c343778a574719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1277c27a-baee-4d54-a1c7-60ccb70ac0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1277c27a-baee-4d54-a1c7-60ccb70ac0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4eb859-a31a-40b7-a8cd-330c7b6e2acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4eb859-a31a-40b7-a8cd-330c7b6e2acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c86f9710-1f6f-45f2-a722-bf0b6305d89e', 'volume_name': 'volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19fb9eb-fab7-44a2-ac7a-63613f0dac32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19fb9eb-fab7-44a2-ac7a-63613f0dac32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2efe0ac-a614-4d64-aae8-ab168e5dad07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:22 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Volume c86f9710-1f6f-45f2-a722-bf0b6305d89e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e', 'volume_size': 1} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86f9710-1f6f-45f2-a722-bf0b6305d89e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffefa9b108049b7a5d2382ac26bfdda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:22Z,use_quota=True,user_id='1ebc3e6f309c4b3b85c343778a574719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Creating volume c86f9710-1f6f-45f2-a722-bf0b6305d89e {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:22 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:22 devstack sudo[115670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e 1073741824 Aug 13 09:43:22 devstack sudo[115670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Flow 'volume_create_manager' (fe301770-e004-4fad-8385-1c229d4df4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ef9c1f-64d1-47a8-ac05-b3dc414941f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ef9c1f-64d1-47a8-ac05-b3dc414941f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-785738111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1cbd316-96d6-4711-b0c8-81eaef71e21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef869c954b4909aa2881532ea78c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:22Z,use_quota=True,user_id='203c22f10abb49a3a6c7430c20fe0c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d8f221-0cd2-4d8d-bbd8-c4112f75d4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d8f221-0cd2-4d8d-bbd8-c4112f75d4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8755b8ed-91c0-4480-b04a-b8d6bcf62739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8755b8ed-91c0-4480-b04a-b8d6bcf62739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1cbd316-96d6-4711-b0c8-81eaef71e21f', 'volume_name': 'volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099aa323-9a7e-41a7-8b10-e87a3df72778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099aa323-9a7e-41a7-8b10-e87a3df72778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c555a1-1ace-4531-a6d8-0602b817bd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:22 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Volume c1cbd316-96d6-4711-b0c8-81eaef71e21f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f', 'volume_size': 1} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:22 devstack sudo[115670]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e 1073741824" returned: 0 in 0.547s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:22 devstack sudo[115676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e Aug 13 09:43:22 devstack sudo[115676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:23 devstack sudo[115676]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e" returned: 0 in 0.303s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-785738111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1cbd316-96d6-4711-b0c8-81eaef71e21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef869c954b4909aa2881532ea78c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:22Z,use_quota=True,user_id='203c22f10abb49a3a6c7430c20fe0c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Creating volume c1cbd316-96d6-4711-b0c8-81eaef71e21f {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:23 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2efe0ac-a614-4d64-aae8-ab168e5dad07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d9701ce-c9fb-4cb0-81f5-6fb2181d70d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:23 devstack sudo[115681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f 1073741824 Aug 13 09:43:23 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Volume volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e (c86f9710-1f6f-45f2-a722-bf0b6305d89e): created successfully Aug 13 09:43:23 devstack sudo[115681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d9701ce-c9fb-4cb0-81f5-6fb2181d70d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Flow 'volume_create_manager' (6c165461-8cc7-4bdc-b367-9b740138de45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:23 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e92aebe3-337e-4847-8b9a-19d0e2a93eb0 tempest-CinderUnicodeTest-1608749194 None] Created volume successfully. Aug 13 09:43:23 devstack sudo[115681]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f 1073741824" returned: 0 in 0.551s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:23 devstack sudo[115687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f Aug 13 09:43:23 devstack sudo[115687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:24 devstack sudo[115687]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f" returned: 0 in 0.334s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c555a1-1ace-4531-a6d8-0602b817bd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08909f1c-2323-42d1-a726-dc26783c364a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:24 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Volume volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f (c1cbd316-96d6-4711-b0c8-81eaef71e21f): created successfully Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08909f1c-2323-42d1-a726-dc26783c364a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Flow 'volume_create_manager' (fe301770-e004-4fad-8385-1c229d4df4bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:24 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-37735e67-0328-47e1-8d57-d8d893e27d06 tempest-ProjectReaderTests-683284509 None] Created volume successfully. Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d02c4bdb-c32a-42e8-9fe7-787b5d5cb0f8 tempest-ProjectAdminTests-301553363 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94670) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Flow 'volume_create_manager' (3f9cb52c-9c28-4c8d-b34d-bc8aa5f2a2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f27e60-0584-40f7-9860-4c3817cdce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f27e60-0584-40f7-9860-4c3817cdce10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-716769226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf71048c-c1dd-4ff8-ba4c-4473d1052542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffefa9b108049b7a5d2382ac26bfdda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:25Z,use_quota=True,user_id='1ebc3e6f309c4b3b85c343778a574719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b379d36-3ab7-40fe-a5a4-ce203c35b2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b379d36-3ab7-40fe-a5a4-ce203c35b2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf68ff5-be67-41f0-973d-826bc3c4b1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf68ff5-be67-41f0-973d-826bc3c4b1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf71048c-c1dd-4ff8-ba4c-4473d1052542', 'volume_name': 'volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af144f0e-6e58-4b42-88db-84df2b92833d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af144f0e-6e58-4b42-88db-84df2b92833d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0aee9ee-ec1f-46bd-95e1-210059c59ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:24 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Volume bf71048c-c1dd-4ff8-ba4c-4473d1052542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542', 'volume_size': 1} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-716769226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf71048c-c1dd-4ff8-ba4c-4473d1052542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffefa9b108049b7a5d2382ac26bfdda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:25Z,use_quota=True,user_id='1ebc3e6f309c4b3b85c343778a574719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Creating volume bf71048c-c1dd-4ff8-ba4c-4473d1052542 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:24 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:24 devstack sudo[115690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 1073741824 Aug 13 09:43:24 devstack sudo[115690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Acquiring lock "cinder-c1cbd316-96d6-4711-b0c8-81eaef71e21f-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Lock "cinder-c1cbd316-96d6-4711-b0c8-81eaef71e21f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Acquiring lock "cinder-quobyte-c1cbd316-96d6-4711-b0c8-81eaef71e21f" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:25 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Lock "cinder-quobyte-c1cbd316-96d6-4711-b0c8-81eaef71e21f" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:25 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fb59be-0a6c-4a33-b875-dc67a0a2e52c]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:25 devstack sudo[115690]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 1073741824" returned: 0 in 0.633s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:25 devstack sudo[115696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f Aug 13 09:43:25 devstack sudo[115696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:25 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=334,cinder:SELECT=210,cinder:INSERT=79,cinder:DELETE=25 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:43:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:25 devstack sudo[115698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 Aug 13 09:43:25 devstack sudo[115698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:25 devstack sudo[115696]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f" returned: 0 in 0.470s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:25 devstack sudo[115705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f Aug 13 09:43:25 devstack sudo[115705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:25 devstack sudo[115698]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542" returned: 0 in 0.390s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0aee9ee-ec1f-46bd-95e1-210059c59ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97a2407-d9ff-4370-8a2a-a67c4ffa2f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:26 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Volume volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 (bf71048c-c1dd-4ff8-ba4c-4473d1052542): created successfully Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97a2407-d9ff-4370-8a2a-a67c4ffa2f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Flow 'volume_create_manager' (3f9cb52c-9c28-4c8d-b34d-bc8aa5f2a2a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=229,cinder:UPDATE=288,cinder:DELETE=31,cinder:INSERT=82 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:43:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-7d64c3f5-6b86-410c-888a-670ec62f3b96 tempest-CinderUnicodeTest-1608749194 None] Created volume successfully. Aug 13 09:43:26 devstack sudo[115705]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c1cbd316-96d6-4711-b0c8-81eaef71e21f" returned: 0 in 0.445s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Lock "cinder-quobyte-c1cbd316-96d6-4711-b0c8-81eaef71e21f" released by "delete_volume" :: held 0.988s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Created reservations ['71e83d55-2f44-4bf3-baca-e6b14a8fd6de', '5ad63b33-c366-4dab-8252-0c1e0dbb1b7f', '0690b3d6-d111-42dc-a52d-e228ad7bda21', '1da77a7b-75b1-418c-a798-d2b3d52702ad'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:26 devstack sudo[115708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:26 devstack sudo[115708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:26 devstack sudo[115708]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.412s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Deleted volume successfully. Aug 13 09:43:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-5be930af-a402-471c-85b7-85365c9f9862 tempest-ProjectReaderTests-683284509 None] Lock "cinder-c1cbd316-96d6-4711-b0c8-81eaef71e21f-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] Creating offline snapshot c1c51737-c6e3-4c48-ae54-90410af7b196 of volume bf71048c-c1dd-4ff8-ba4c-4473d1052542 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:43:27 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c13b94f-2efd-4231-8768-9eaacd5f7d65]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:27 devstack sudo[115711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 Aug 13 09:43:27 devstack sudo[115711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:27 devstack sudo[115711]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542" returned: 0 in 0.428s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:27 devstack sudo[115716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196 1G Aug 13 09:43:27 devstack sudo[115716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:28 devstack sudo[115716]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196 1G" returned: 0 in 0.466s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:28 devstack sudo[115722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196 Aug 13 09:43:28 devstack sudo[115722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:28 devstack sudo[115722]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196" returned: 0 in 0.343s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:28 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196 is being set with open permissions: ugo+rw Aug 13 09:43:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:28 devstack sudo[115728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196 Aug 13 09:43:28 devstack sudo[115728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:28 devstack sudo[115728]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196" returned: 0 in 0.337s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:28 devstack sudo[115731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.info Aug 13 09:43:28 devstack sudo[115731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:29 devstack sudo[115731]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (a50f24a7-42cd-4d06-8ef8-f74ee7c77327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72abe89-4bf4-4673-893a-0ed166979281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.info" returned: 0 in 0.433s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:29 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.info is being set with open permissions: ugo+rw Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:29 devstack sudo[115734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.info Aug 13 09:43:29 devstack sudo[115734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72abe89-4bf4-4673-893a-0ed166979281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-96358911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50973b0b-7e3b-4c32-8683-d2b47c6bcd27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:29Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f097a19c-9ece-447d-9b8f-5ce83b93ddbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f097a19c-9ece-447d-9b8f-5ce83b93ddbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ac20ef-6e43-46ce-9be1-e898ced69c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ac20ef-6e43-46ce-9be1-e898ced69c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50973b0b-7e3b-4c32-8683-d2b47c6bcd27', 'volume_name': 'volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc2fbd9-1e97-4f76-8877-d130aa9b4306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc2fbd9-1e97-4f76-8877-d130aa9b4306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa18ec39-e2df-43dd-8528-f48815882327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:29 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Volume 50973b0b-7e3b-4c32-8683-d2b47c6bcd27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27', 'volume_size': 1} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:29 devstack sudo[115734]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.info" returned: 0 in 0.291s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.240s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-96358911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50973b0b-7e3b-4c32-8683-d2b47c6bcd27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:29Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Creating volume 50973b0b-7e3b-4c32-8683-d2b47c6bcd27 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:29 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:29 devstack sudo[115737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 1073741824 Aug 13 09:43:29 devstack sudo[115737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:29 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-248b3cd9-d4f3-4816-b553-394f97efb497 tempest-CinderUnicodeTest-1608749194 None] Create snapshot completed successfully Aug 13 09:43:30 devstack sudo[115737]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 1073741824" returned: 0 in 0.613s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:30 devstack sudo[115743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 Aug 13 09:43:30 devstack sudo[115743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Acquiring lock "cinder-c1c51737-c6e3-4c48-ae54-90410af7b196-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Lock "cinder-c1c51737-c6e3-4c48-ae54-90410af7b196-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Acquiring lock "cinder-quobyte-bf71048c-c1dd-4ff8-ba4c-4473d1052542" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Lock "cinder-quobyte-bf71048c-c1dd-4ff8-ba4c-4473d1052542" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Acquiring lock "cinder-quobyte-c1c51737-c6e3-4c48-ae54-90410af7b196" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Lock "cinder-quobyte-c1c51737-c6e3-4c48-ae54-90410af7b196" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Deleting offline snapshot c1c51737-c6e3-4c48-ae54-90410af7b196 of volume bf71048c-c1dd-4ff8-ba4c-4473d1052542 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] snapshot_file for this snap is: volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd44777c-a9f3-41a4-a9fe-0487c6eb3292]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:30 devstack sudo[115743]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27" returned: 0 in 0.280s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa18ec39-e2df-43dd-8528-f48815882327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2707a8-6263-4985-9469-a25871c9b8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:30 devstack sudo[115746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196 Aug 13 09:43:30 devstack sudo[115746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:30 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Volume volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 (50973b0b-7e3b-4c32-8683-d2b47c6bcd27): created successfully Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2707a8-6263-4985-9469-a25871c9b8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (a50f24a7-42cd-4d06-8ef8-f74ee7c77327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:30 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6a55577b-737b-4e5c-9aeb-8f78d05c1a64 tempest-ProjectMemberTests-1073032951 None] Created volume successfully. Aug 13 09:43:30 devstack sudo[115746]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196" returned: 0 in 0.386s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1d987f-b9d3-4ea1-841d-1b73a98b02ef]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:30 devstack sudo[115752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 Aug 13 09:43:30 devstack sudo[115752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:31 devstack sudo[115752]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542" returned: 0 in 0.380s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:31 devstack sudo[115757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196 Aug 13 09:43:31 devstack sudo[115757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:31 devstack sudo[115757]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196" returned: 0 in 0.386s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:31 devstack sudo[115763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196 Aug 13 09:43:31 devstack sudo[115763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] Creating offline snapshot 38260bd7-14eb-4bca-a029-9018b23e2d2d of volume 50973b0b-7e3b-4c32-8683-d2b47c6bcd27 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:43:31 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0db2d37-45a1-4cbd-bc95-49cfd51e6624]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:31 devstack sudo[115763]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542.c1c51737-c6e3-4c48-ae54-90410af7b196" returned: 0 in 0.277s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Lock "cinder-quobyte-c1c51737-c6e3-4c48-ae54-90410af7b196" released by "_delete_snapshot" :: held 1.562s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:31 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Lock "cinder-quobyte-bf71048c-c1dd-4ff8-ba4c-4473d1052542" released by "delete_snapshot" :: held 1.593s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:32 devstack sudo[115766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 Aug 13 09:43:32 devstack sudo[115766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:32 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Created reservations ['fbdd22ab-f9de-43b0-a7a5-726ace50cdd0', '0f2fcc24-34d4-4781-8e54-48079b2ac661', '9b93831e-fe99-41bf-888c-efb32adec653', '74ad34a2-4e5e-4c6d-b424-7ed132dfd12b'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:32 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Delete snapshot completed successfully. Aug 13 09:43:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-7ba5f713-e123-4875-b3c4-7fb0b0e83685 tempest-CinderUnicodeTest-1608749194 None] Lock "cinder-c1c51737-c6e3-4c48-ae54-90410af7b196-delete_snapshot" released by "delete_snapshot" :: held 1.790s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:32 devstack sudo[115766]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27" returned: 0 in 0.414s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:32 devstack sudo[115771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d 1G Aug 13 09:43:32 devstack sudo[115771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Acquiring lock "cinder-bf71048c-c1dd-4ff8-ba4c-4473d1052542-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Lock "cinder-bf71048c-c1dd-4ff8-ba4c-4473d1052542-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Acquiring lock "cinder-quobyte-bf71048c-c1dd-4ff8-ba4c-4473d1052542" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Lock "cinder-quobyte-bf71048c-c1dd-4ff8-ba4c-4473d1052542" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:32 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22b171c-ca72-4700-8e63-218892970d17]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:32 devstack sudo[115776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 Aug 13 09:43:32 devstack sudo[115776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:32 devstack sudo[115771]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d 1G" returned: 0 in 0.544s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:32 devstack sudo[115778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d Aug 13 09:43:32 devstack sudo[115778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:33 devstack sudo[115776]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542" returned: 0 in 0.411s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:33 devstack sudo[115785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542 Aug 13 09:43:33 devstack sudo[115785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:33 devstack sudo[115778]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d" returned: 0 in 0.353s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:33 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d is being set with open permissions: ugo+rw Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:33 devstack sudo[115788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d Aug 13 09:43:33 devstack sudo[115788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:33 devstack sudo[115785]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-bf71048c-c1dd-4ff8-ba4c-4473d1052542" returned: 0 in 0.283s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Lock "cinder-quobyte-bf71048c-c1dd-4ff8-ba4c-4473d1052542" released by "delete_volume" :: held 0.763s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Created reservations ['3aa8c5cc-086f-420f-8e13-40b04260e215', 'ec4c6c03-18d5-42b5-97da-3d12395bc33e', '2c9a640c-0f9f-4323-9692-4401627c5111', '74797b2a-7433-428b-8197-980d85d7f680'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:33 devstack sudo[115788]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d" returned: 0 in 0.303s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:33 devstack sudo[115792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.info Aug 13 09:43:33 devstack sudo[115792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:33 devstack sudo[115794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:33 devstack sudo[115794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Acquiring lock "cinder-c86f9710-1f6f-45f2-a722-bf0b6305d89e-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Lock "cinder-c86f9710-1f6f-45f2-a722-bf0b6305d89e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Acquiring lock "cinder-quobyte-c86f9710-1f6f-45f2-a722-bf0b6305d89e" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Lock "cinder-quobyte-c86f9710-1f6f-45f2-a722-bf0b6305d89e" acquired by "delete_volume" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:33 devstack sudo[115794]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:33 devstack sudo[115792]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.info" returned: 0 in 0.416s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.389s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:33 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.info is being set with open permissions: ugo+rw Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[705023f4-809d-42d7-b2ac-5de0330b9522]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:33 devstack sudo[115832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.info Aug 13 09:43:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:33 devstack sudo[115832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:34 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Deleted volume successfully. Aug 13 09:43:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-67bcc14e-0ee9-4eb7-bf8d-539f1d38a2b9 tempest-CinderUnicodeTest-1608749194 None] Lock "cinder-bf71048c-c1dd-4ff8-ba4c-4473d1052542-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:34 devstack sudo[115834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e Aug 13 09:43:34 devstack sudo[115834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:34 devstack sudo[115832]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.info" returned: 0 in 0.315s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:34 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-300afab7-5ee0-424e-8a80-72c3aad53ea2 tempest-ProjectMemberTests-1073032951 None] Create snapshot completed successfully Aug 13 09:43:34 devstack sudo[115834]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e" returned: 0 in 0.496s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:34 devstack sudo[115842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e Aug 13 09:43:34 devstack sudo[115842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:34 devstack sudo[115842]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c86f9710-1f6f-45f2-a722-bf0b6305d89e" returned: 0 in 0.276s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Lock "cinder-quobyte-c86f9710-1f6f-45f2-a722-bf0b6305d89e" released by "delete_volume" :: held 0.870s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:34 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Created reservations ['869b8f0d-44fe-4b55-9f16-5e0b9e76cf76', 'c4bc241a-409e-4ebd-9e94-3a7558eb8f35', '05baac90-54ef-4399-a1f7-3f464125eea5', 'bfbc8710-0b88-4e9a-a5d0-02cf55bd21f2'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-38260bd7-14eb-4bca-a029-9018b23e2d2d-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Lock "cinder-38260bd7-14eb-4bca-a029-9018b23e2d2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-50973b0b-7e3b-4c32-8683-d2b47c6bcd27" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-50973b0b-7e3b-4c32-8683-d2b47c6bcd27" acquired by "delete_snapshot" :: waited 0.044s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-38260bd7-14eb-4bca-a029-9018b23e2d2d" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:35 devstack sudo[115846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:35 devstack sudo[115846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-38260bd7-14eb-4bca-a029-9018b23e2d2d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Deleting offline snapshot 38260bd7-14eb-4bca-a029-9018b23e2d2d of volume 50973b0b-7e3b-4c32-8683-d2b47c6bcd27 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] snapshot_file for this snap is: volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a774c872-e7cb-408b-953b-0a3519e67856]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:35 devstack sudo[115848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d Aug 13 09:43:35 devstack sudo[115848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:35 devstack sudo[115846]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.334s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:35 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Deleted volume successfully. Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-71db2406-cdea-4a8d-876e-9233d2873399 tempest-CinderUnicodeTest-1608749194 None] Lock "cinder-c86f9710-1f6f-45f2-a722-bf0b6305d89e-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:35 devstack sudo[115848]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d" returned: 0 in 0.406s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9678ca-8091-49b1-a34b-e03b0b16518f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:35 devstack sudo[115854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 Aug 13 09:43:35 devstack sudo[115854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:36 devstack sudo[115854]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27" returned: 0 in 0.405s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:36 devstack sudo[115861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d Aug 13 09:43:36 devstack sudo[115861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:36 devstack sudo[115861]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d" returned: 0 in 0.456s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:36 devstack sudo[115867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d Aug 13 09:43:36 devstack sudo[115867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:36 devstack sudo[115867]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27.38260bd7-14eb-4bca-a029-9018b23e2d2d" returned: 0 in 0.311s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-38260bd7-14eb-4bca-a029-9018b23e2d2d" released by "_delete_snapshot" :: held 1.772s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:36 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-50973b0b-7e3b-4c32-8683-d2b47c6bcd27" released by "delete_snapshot" :: held 1.811s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:36 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Created reservations ['9e8bb590-c5c2-4402-94fe-1174e58aa226', '0fea971a-2ca2-4523-8813-4d0a39fdd590', 'c4c2f1b3-f9f4-4696-add5-ff2fbfa40e39', 'd060121e-2d3d-4e45-8c07-0b95e4fbbc19'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:37 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Delete snapshot completed successfully. Aug 13 09:43:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e5f7a568-967a-483b-bef4-b1e55d7709cf tempest-ProjectMemberTests-1073032951 None] Lock "cinder-38260bd7-14eb-4bca-a029-9018b23e2d2d-delete_snapshot" released by "delete_snapshot" :: held 2.020s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-50973b0b-7e3b-4c32-8683-d2b47c6bcd27-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-50973b0b-7e3b-4c32-8683-d2b47c6bcd27-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-50973b0b-7e3b-4c32-8683-d2b47c6bcd27" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-50973b0b-7e3b-4c32-8683-d2b47c6bcd27" acquired by "delete_volume" :: waited 0.020s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:37 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a417a085-931c-4569-a3f5-4f9fb1a67076]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:37 devstack sudo[115870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 Aug 13 09:43:37 devstack sudo[115870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:37 devstack sudo[115870]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27" returned: 0 in 0.472s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:37 devstack sudo[115876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27 Aug 13 09:43:37 devstack sudo[115876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:38 devstack sudo[115876]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-50973b0b-7e3b-4c32-8683-d2b47c6bcd27" returned: 0 in 0.311s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-50973b0b-7e3b-4c32-8683-d2b47c6bcd27" released by "delete_volume" :: held 0.866s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:38 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Created reservations ['03702c86-4407-4346-9cc7-c32783e0380d', '6eae6980-baeb-4983-85e1-220a2e5a24d4', '8e705a3a-6a10-491b-8cab-bf3891d3655f', '0ea62d01-e087-4a8a-820d-80f238696d07'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:38 devstack sudo[115879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:38 devstack sudo[115879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:38 devstack sudo[115879]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.338s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:38 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:38 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Deleted volume successfully. Aug 13 09:43:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-efef7fc4-48be-4002-ba94-686b82585754 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-50973b0b-7e3b-4c32-8683-d2b47c6bcd27-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:38 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:38 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (e12d0abe-9270-4192-95e3-20b5eefff61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da139434-ee61-4523-b2c3-8445dd0f388e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da139434-ee61-4523-b2c3-8445dd0f388e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599176141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da4da95-6abd-438d-aca0-152f699c228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:39Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d327ddc-ff94-450b-af6a-efeaca1052e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d327ddc-ff94-450b-af6a-efeaca1052e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb99ca0-7ce6-4b9b-945a-de117237067c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb99ca0-7ce6-4b9b-945a-de117237067c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4da4da95-6abd-438d-aca0-152f699c228d', 'volume_name': 'volume-4da4da95-6abd-438d-aca0-152f699c228d', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb935d59-806e-448e-8f9f-b8b1ac49ec5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb935d59-806e-448e-8f9f-b8b1ac49ec5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e4c863-0bf6-4ef9-932f-2e74114cec85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:39 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Volume 4da4da95-6abd-438d-aca0-152f699c228d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4da4da95-6abd-438d-aca0-152f699c228d', 'volume_size': 1} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599176141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da4da95-6abd-438d-aca0-152f699c228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:39Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Creating volume 4da4da95-6abd-438d-aca0-152f699c228d {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:39 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:39 devstack sudo[115888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d 1073741824 Aug 13 09:43:39 devstack sudo[115888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:39 devstack sudo[115888]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d 1073741824" returned: 0 in 0.697s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:39 devstack sudo[115894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d Aug 13 09:43:39 devstack sudo[115894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:40 devstack sudo[115894]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d" returned: 0 in 0.369s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e4c863-0bf6-4ef9-932f-2e74114cec85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da4da95-6abd-438d-aca0-152f699c228d', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e8efbe-f1a0-434c-92d3-110bcdbd0033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:40 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Volume volume-4da4da95-6abd-438d-aca0-152f699c228d (4da4da95-6abd-438d-aca0-152f699c228d): created successfully Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e8efbe-f1a0-434c-92d3-110bcdbd0033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (e12d0abe-9270-4192-95e3-20b5eefff61a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:40 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-89262078-e064-4922-93db-9edfb0bb7e15 tempest-ProjectMemberTests-1073032951 None] Created volume successfully. Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Flow 'volume_create_manager' (41853697-fcfd-47b3-8fa1-0cb576ed6b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1ae211-4334-4c02-9050-e0ee357b1160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1ae211-4334-4c02-9050-e0ee357b1160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-136762479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3124c524-b180-4137-90e7-206adc93c792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc412bf921ed437295b0e3fc6f2b8df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:40Z,use_quota=True,user_id='ad66161a7dad4ad6be5a9a932989519e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d9628d-0dfe-4987-afc0-ba1d36020727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d9628d-0dfe-4987-afc0-ba1d36020727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80da5699-2d0a-40c5-9962-e404ec90c4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80da5699-2d0a-40c5-9962-e404ec90c4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3124c524-b180-4137-90e7-206adc93c792', 'volume_name': 'volume-3124c524-b180-4137-90e7-206adc93c792', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862785c2-7f4f-4d4d-8b22-2e4fef2f9b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862785c2-7f4f-4d4d-8b22-2e4fef2f9b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd8c18a-0612-4694-86ff-683abb086909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:40 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Volume 3124c524-b180-4137-90e7-206adc93c792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3124c524-b180-4137-90e7-206adc93c792', 'volume_size': 1} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-136762479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3124c524-b180-4137-90e7-206adc93c792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc412bf921ed437295b0e3fc6f2b8df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:40Z,use_quota=True,user_id='ad66161a7dad4ad6be5a9a932989519e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Creating volume 3124c524-b180-4137-90e7-206adc93c792 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:40 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:40 devstack sudo[115898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792 1073741824 Aug 13 09:43:40 devstack sudo[115898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:40 devstack sudo[115898]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792 1073741824" returned: 0 in 0.463s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:41 devstack sudo[115904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792 Aug 13 09:43:41 devstack sudo[115904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:41 devstack sudo[115904]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792" returned: 0 in 0.316s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd8c18a-0612-4694-86ff-683abb086909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3124c524-b180-4137-90e7-206adc93c792', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b94913-9d87-43df-88e0-dfaa4ceccf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:41 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Volume volume-3124c524-b180-4137-90e7-206adc93c792 (3124c524-b180-4137-90e7-206adc93c792): created successfully Aug 13 09:43:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b94913-9d87-43df-88e0-dfaa4ceccf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:41 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Flow 'volume_create_manager' (41853697-fcfd-47b3-8fa1-0cb576ed6b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:41 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] Creating offline snapshot 0f3837ef-3354-4a8d-bb57-d282ef3808ca of volume 4da4da95-6abd-438d-aca0-152f699c228d {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:43:41 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3e6495ed-b454-4e59-93d4-368270b3a7a7 tempest-ProjectReaderTests-708195512 None] Created volume successfully. Aug 13 09:43:41 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddca96cb-6dc5-42bb-8192-26aed7a07f91]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:41 devstack sudo[115907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d Aug 13 09:43:41 devstack sudo[115907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:41 devstack sudo[115907]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d" returned: 0 in 0.425s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:41 devstack sudo[115913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca 1G Aug 13 09:43:41 devstack sudo[115913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:42 devstack sudo[115913]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca 1G" returned: 0 in 0.443s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4da4da95-6abd-438d-aca0-152f699c228d -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:42 devstack sudo[115919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4da4da95-6abd-438d-aca0-152f699c228d -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca Aug 13 09:43:42 devstack sudo[115919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:42 devstack sudo[115919]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4da4da95-6abd-438d-aca0-152f699c228d -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca" returned: 0 in 0.387s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:42 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca is being set with open permissions: ugo+rw Aug 13 09:43:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:42 devstack sudo[115924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca Aug 13 09:43:42 devstack sudo[115924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:42 devstack sudo[115924]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca" returned: 0 in 0.247s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:43 devstack sudo[115927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.info Aug 13 09:43:43 devstack sudo[115927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:43 devstack sudo[115927]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.info" returned: 0 in 0.248s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:43 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.info is being set with open permissions: ugo+rw Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:43 devstack sudo[115930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.info Aug 13 09:43:43 devstack sudo[115930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:43 devstack sudo[115932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:43 devstack sudo[115932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:43 devstack sudo[115930]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.info" returned: 0 in 0.273s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.136s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.807s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:43 devstack sudo[115932]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] Creating offline snapshot 768df931-09ed-42d9-813c-c28e35c7feb0 of volume 3124c524-b180-4137-90e7-206adc93c792 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.315s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9da6564-eece-4b4c-9ca4-bb1a81543e64]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:43:43 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-caa991b3-d616-4aab-9fbb-d6515f8e66a7 tempest-ProjectMemberTests-1073032951 None] Create snapshot completed successfully Aug 13 09:43:43 devstack sudo[115936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792 Aug 13 09:43:43 devstack sudo[115936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:43 devstack sudo[115936]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792" returned: 0 in 0.390s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:43 devstack sudo[115941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0 1G Aug 13 09:43:43 devstack sudo[115941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:44 devstack sudo[115941]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0 1G" returned: 0 in 0.394s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3124c524-b180-4137-90e7-206adc93c792 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:44 devstack sudo[115946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3124c524-b180-4137-90e7-206adc93c792 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0 Aug 13 09:43:44 devstack sudo[115946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-0f3837ef-3354-4a8d-bb57-d282ef3808ca-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-0f3837ef-3354-4a8d-bb57-d282ef3808ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-4da4da95-6abd-438d-aca0-152f699c228d" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-4da4da95-6abd-438d-aca0-152f699c228d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-0f3837ef-3354-4a8d-bb57-d282ef3808ca" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:44 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-0f3837ef-3354-4a8d-bb57-d282ef3808ca" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Deleting offline snapshot 0f3837ef-3354-4a8d-bb57-d282ef3808ca of volume 4da4da95-6abd-438d-aca0-152f699c228d {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:43:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] snapshot_file for this snap is: volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:43:44 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1c57e6-7617-4c92-9c53-ba2272fe4d7b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:44 devstack sudo[115946]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3124c524-b180-4137-90e7-206adc93c792 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0" returned: 0 in 0.429s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:44 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0 is being set with open permissions: ugo+rw Aug 13 09:43:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:44 devstack sudo[115950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca Aug 13 09:43:44 devstack sudo[115950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:44 devstack sudo[115952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0 Aug 13 09:43:44 devstack sudo[115952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:45 devstack sudo[115952]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0" returned: 0 in 0.279s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:45 devstack sudo[115959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.info Aug 13 09:43:45 devstack sudo[115959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:45 devstack sudo[115950]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca" returned: 0 in 0.527s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:45 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4da4da95-6abd-438d-aca0-152f699c228d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:43:45 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9912c556-3e17-430d-8f53-39f8dab6186c]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:45 devstack sudo[115959]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.info" returned: 0 in 0.346s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:45 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.info is being set with open permissions: ugo+rw Aug 13 09:43:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:45 devstack sudo[115962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d Aug 13 09:43:45 devstack sudo[115962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:45 devstack sudo[115965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.info Aug 13 09:43:45 devstack sudo[115965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:45 devstack sudo[115962]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d" returned: 0 in 0.613s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:45 devstack sudo[115965]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.info" returned: 0 in 0.398s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:45 devstack sudo[115972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca Aug 13 09:43:45 devstack sudo[115972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:45 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-8141ee0a-eae4-41b5-8379-bd66a04d41eb tempest-ProjectReaderTests-708195512 None] Create snapshot completed successfully Aug 13 09:43:46 devstack sudo[115972]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca" returned: 0 in 0.366s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:46 devstack sudo[115978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca Aug 13 09:43:46 devstack sudo[115978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:46 devstack sudo[115978]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d.0f3837ef-3354-4a8d-bb57-d282ef3808ca" returned: 0 in 0.274s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-0f3837ef-3354-4a8d-bb57-d282ef3808ca" released by "_delete_snapshot" :: held 1.940s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-4da4da95-6abd-438d-aca0-152f699c228d" released by "delete_snapshot" :: held 1.968s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:46 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Created reservations ['d5c1ce8a-e0b7-4986-833e-9ac4c6dc3199', '4d6644fe-221d-43b7-9b4d-501044a50aaa', '2dae405c-d25c-4592-a8f3-d31c563809d5', 'e2cd05f2-ab42-4722-995d-13fe70305141'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:46 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Delete snapshot completed successfully. Aug 13 09:43:46 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-225dddcc-1e99-4939-bd8a-75eeb9108338 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-0f3837ef-3354-4a8d-bb57-d282ef3808ca-delete_snapshot" released by "delete_snapshot" :: held 2.142s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-768df931-09ed-42d9-813c-c28e35c7feb0-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Lock "cinder-768df931-09ed-42d9-813c-c28e35c7feb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-quobyte-3124c524-b180-4137-90e7-206adc93c792" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-3124c524-b180-4137-90e7-206adc93c792" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-quobyte-768df931-09ed-42d9-813c-c28e35c7feb0" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-768df931-09ed-42d9-813c-c28e35c7feb0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Deleting offline snapshot 768df931-09ed-42d9-813c-c28e35c7feb0 of volume 3124c524-b180-4137-90e7-206adc93c792 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] snapshot_file for this snap is: volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ba127d-31eb-47cd-9542-ee0793e2d58a]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:47 devstack sudo[115981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0 Aug 13 09:43:47 devstack sudo[115981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:47 devstack sudo[115981]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0" returned: 0 in 0.435s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3124c524-b180-4137-90e7-206adc93c792(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc8431a-69ac-4a6b-b677-a54a04f1751e]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:47 devstack sudo[115986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792 Aug 13 09:43:47 devstack sudo[115986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-4da4da95-6abd-438d-aca0-152f699c228d-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-4da4da95-6abd-438d-aca0-152f699c228d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-4da4da95-6abd-438d-aca0-152f699c228d" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-4da4da95-6abd-438d-aca0-152f699c228d" acquired by "delete_volume" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:48 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde006bf-0b73-43ba-b1eb-79056b4ca093]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:48 devstack sudo[115988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d Aug 13 09:43:48 devstack sudo[115988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:48 devstack sudo[115986]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792" returned: 0 in 0.453s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:48 devstack sudo[115994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0 Aug 13 09:43:48 devstack sudo[115994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:48 devstack sudo[115988]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d" returned: 0 in 0.440s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:48 devstack sudo[116003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d Aug 13 09:43:48 devstack sudo[116003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:48 devstack sudo[115994]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0" returned: 0 in 0.395s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:48 devstack sudo[116006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0 Aug 13 09:43:48 devstack sudo[116006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:48 devstack sudo[116003]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4da4da95-6abd-438d-aca0-152f699c228d" returned: 0 in 0.331s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-4da4da95-6abd-438d-aca0-152f699c228d" released by "delete_volume" :: held 0.850s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:48 devstack sudo[116006]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792.768df931-09ed-42d9-813c-c28e35c7feb0" returned: 0 in 0.323s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-768df931-09ed-42d9-813c-c28e35c7feb0" released by "_delete_snapshot" :: held 1.733s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-3124c524-b180-4137-90e7-206adc93c792" released by "delete_snapshot" :: held 1.761s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Created reservations ['8be5b00c-8c10-47ea-a3c9-8c92d1e1bd29', '9fbff0a9-e285-41e1-810c-0471f02f260e', '6a6eeb54-1183-4b23-8ac7-84e78e9cff5e', '73e0422f-5cae-4ecd-911a-452ba932e930'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Created reservations ['5a36683c-7b1e-4a35-ba2b-6248a3ea12dc', '7d88818f-0a00-4947-9b86-7fc594bf08d6', 'a0379b5c-19b5-454c-8042-ea810753f493', 'bcbdecd4-e3c2-49c8-ab82-07f744ccecc9'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:49 devstack sudo[116010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:49 devstack sudo[116010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:49 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Delete snapshot completed successfully. Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-9e74afd3-7a5a-4291-832f-7a08f61415d2 tempest-ProjectReaderTests-708195512 None] Lock "cinder-768df931-09ed-42d9-813c-c28e35c7feb0-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-3124c524-b180-4137-90e7-206adc93c792-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:49 devstack sudo[116010]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Lock "cinder-3124c524-b180-4137-90e7-206adc93c792-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.282s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:49 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Deleted volume successfully. Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bbd2d17a-9cd9-40db-92db-ee1808d80378 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-4da4da95-6abd-438d-aca0-152f699c228d-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-quobyte-3124c524-b180-4137-90e7-206adc93c792" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-3124c524-b180-4137-90e7-206adc93c792" acquired by "delete_volume" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54eb90b-613f-485b-bf48-5b7d7bc42eb9]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:49 devstack sudo[116013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792 Aug 13 09:43:49 devstack sudo[116013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:49 devstack sudo[116013]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792" returned: 0 in 0.396s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:49 devstack sudo[116018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792 Aug 13 09:43:49 devstack sudo[116018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:50 devstack sudo[116018]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-3124c524-b180-4137-90e7-206adc93c792" returned: 0 in 0.318s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-3124c524-b180-4137-90e7-206adc93c792" released by "delete_volume" :: held 0.791s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Created reservations ['b65ffc10-c08b-4b26-b3a8-8e7edcbb13a9', 'b71355b0-cdb6-4e3a-a6f3-a2b202eececc', '5366d8e0-f351-473c-a220-24715deaff92', 'f7d6d4c1-e586-4974-87ec-19eaae9c26dc'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:50 devstack sudo[116022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:50 devstack sudo[116022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:50 devstack sudo[116022]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.307s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:43:50 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Deleted volume successfully. Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (a0b184fe-47d9-4a2b-a2bc-8be14b50fb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e8d841-2d82-4912-ae1e-a7f6772a1d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21ea57d8-0b28-479d-858b-21259fe805e0 tempest-ProjectReaderTests-708195512 None] Lock "cinder-3124c524-b180-4137-90e7-206adc93c792-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e8d841-2d82-4912-ae1e-a7f6772a1d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1803877982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37af2ee-a22f-4c73-8fb8-5f7a83c08e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:51Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dacf029a-e21b-473d-b5f6-67ce70773dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dacf029a-e21b-473d-b5f6-67ce70773dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef43971-05d6-431a-b659-c699df7c8755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef43971-05d6-431a-b659-c699df7c8755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b37af2ee-a22f-4c73-8fb8-5f7a83c08e41', 'volume_name': 'volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9490bde8-0ba8-4583-b47c-83dd9c0eeaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9490bde8-0ba8-4583-b47c-83dd9c0eeaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b23b554-220e-4786-ac3e-0117ffda5ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:50 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Volume b37af2ee-a22f-4c73-8fb8-5f7a83c08e41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41', 'volume_size': 1} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1803877982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37af2ee-a22f-4c73-8fb8-5f7a83c08e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:51Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Creating volume b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:50 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:50 devstack sudo[116025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 1073741824 Aug 13 09:43:50 devstack sudo[116025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Flow 'volume_create_manager' (59f5c5e9-25e8-47fc-8b25-047e78ed78de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07870f2a-a950-4cef-a919-938aa8c56b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07870f2a-a950-4cef-a919-938aa8c56b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-524631728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171c4cd3-5b09-4e56-9e74-be1ef9b91185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc412bf921ed437295b0e3fc6f2b8df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:51Z,use_quota=True,user_id='ad66161a7dad4ad6be5a9a932989519e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc61f504-5ea4-4427-b934-0c81502a7b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc61f504-5ea4-4427-b934-0c81502a7b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:51 devstack sudo[116025]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc7f1ad-210c-4c5c-9ba8-da816887605b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc7f1ad-210c-4c5c-9ba8-da816887605b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '171c4cd3-5b09-4e56-9e74-be1ef9b91185', 'volume_name': 'volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f84b510-53a2-4cf2-8fd1-bcc76b9c0af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f84b510-53a2-4cf2-8fd1-bcc76b9c0af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dc2d76-330d-463e-9706-95770655e0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:51 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Volume 171c4cd3-5b09-4e56-9e74-be1ef9b91185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185', 'volume_size': 1} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 1073741824" returned: 0 in 0.608s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:51 devstack sudo[116031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 Aug 13 09:43:51 devstack sudo[116031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:51 devstack sudo[116031]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41" returned: 0 in 0.340s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-524631728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171c4cd3-5b09-4e56-9e74-be1ef9b91185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc412bf921ed437295b0e3fc6f2b8df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:51Z,use_quota=True,user_id='ad66161a7dad4ad6be5a9a932989519e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Creating volume 171c4cd3-5b09-4e56-9e74-be1ef9b91185 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:51 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b23b554-220e-4786-ac3e-0117ffda5ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:52 devstack sudo[116034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 1073741824 Aug 13 09:43:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0436118-8322-4bc8-8d96-e38508f8acfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:52 devstack sudo[116034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:52 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Volume volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 (b37af2ee-a22f-4c73-8fb8-5f7a83c08e41): created successfully Aug 13 09:43:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0436118-8322-4bc8-8d96-e38508f8acfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (a0b184fe-47d9-4a2b-a2bc-8be14b50fb0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:52 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b463f59d-350d-4653-8d80-6169240f3783 tempest-ProjectMemberTests-1073032951 None] Created volume successfully. Aug 13 09:43:52 devstack sudo[116034]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 1073741824" returned: 0 in 0.488s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:52 devstack sudo[116040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 Aug 13 09:43:52 devstack sudo[116040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:52 devstack sudo[116040]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185" returned: 0 in 0.270s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:43:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dc2d76-330d-463e-9706-95770655e0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3638d000-647b-4297-b367-3a9be3648944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:52 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Volume volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 (171c4cd3-5b09-4e56-9e74-be1ef9b91185): created successfully Aug 13 09:43:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3638d000-647b-4297-b367-3a9be3648944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:52 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Flow 'volume_create_manager' (59f5c5e9-25e8-47fc-8b25-047e78ed78de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:52 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-cafec122-ecab-4e32-9c27-58c6730260af tempest-ProjectReaderTests-708195512 None] Created volume successfully. Aug 13 09:43:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:53 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] Creating offline snapshot 07084307-8e44-479e-bc90-ee452156768a of volume b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:43:53 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[953a8d0e-4be1-4c2d-8537-d04e48c67d4a]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:53 devstack sudo[116043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 Aug 13 09:43:53 devstack sudo[116043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:53 devstack sudo[116043]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41" returned: 0 in 0.462s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:53 devstack sudo[116048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a 1G Aug 13 09:43:53 devstack sudo[116048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:54 devstack sudo[116048]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a 1G" returned: 0 in 0.479s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:54 devstack sudo[116054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a Aug 13 09:43:54 devstack sudo[116054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:54 devstack sudo[116054]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a" returned: 0 in 0.345s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:54 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a is being set with open permissions: ugo+rw Aug 13 09:43:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:54 devstack sudo[116059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a Aug 13 09:43:54 devstack sudo[116059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:54 devstack sudo[116059]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a" returned: 0 in 0.317s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:54 devstack sudo[116062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.info Aug 13 09:43:54 devstack sudo[116062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:55 devstack sudo[116062]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.info" returned: 0 in 0.277s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:55 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.info is being set with open permissions: ugo+rw Aug 13 09:43:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:55 devstack sudo[116065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.info Aug 13 09:43:55 devstack sudo[116065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:55 devstack sudo[116065]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.info" returned: 0 in 0.275s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.818s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:55 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] Creating offline snapshot 9427c4ac-92ba-4e60-b028-5e2873e95ecb of volume 171c4cd3-5b09-4e56-9e74-be1ef9b91185 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:43:55 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-124835ba-3cbe-487a-8222-024873d24147 tempest-ProjectMemberTests-1073032951 None] Create snapshot completed successfully Aug 13 09:43:55 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[907b2245-71a8-447e-87bf-e115d6934c07]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:55 devstack sudo[116068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 Aug 13 09:43:55 devstack sudo[116068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:55 devstack sudo[116068]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185" returned: 0 in 0.404s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:55 devstack sudo[116073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb 1G Aug 13 09:43:55 devstack sudo[116073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:56 devstack sudo[116073]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-07084307-8e44-479e-bc90-ee452156768a-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb 1G" returned: 0 in 0.505s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Lock "cinder-07084307-8e44-479e-bc90-ee452156768a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:56 devstack sudo[116079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb Aug 13 09:43:56 devstack sudo[116079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-07084307-8e44-479e-bc90-ee452156768a" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-07084307-8e44-479e-bc90-ee452156768a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Deleting offline snapshot 07084307-8e44-479e-bc90-ee452156768a of volume b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] snapshot_file for this snap is: volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aede8c-3e03-4628-8017-dc38fe4cc564]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:56 devstack sudo[116081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a Aug 13 09:43:56 devstack sudo[116081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:56 devstack sudo[116079]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb" returned: 0 in 0.381s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:56 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb is being set with open permissions: ugo+rw Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:56 devstack sudo[116086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb Aug 13 09:43:56 devstack sudo[116086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:56 devstack sudo[116081]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a" returned: 0 in 0.453s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7232aabc-8059-45ee-9a0b-4bfce40a8df7]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:57 devstack sudo[116086]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb" returned: 0 in 0.289s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:57 devstack sudo[116093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.info Aug 13 09:43:57 devstack sudo[116093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:57 devstack sudo[116092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 Aug 13 09:43:57 devstack sudo[116092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:57 devstack sudo[116093]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.info" returned: 0 in 0.290s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:57 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.info is being set with open permissions: ugo+rw Aug 13 09:43:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:57 devstack sudo[116099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.info Aug 13 09:43:57 devstack sudo[116099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:57 devstack sudo[116092]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41" returned: 0 in 0.442s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:57 devstack sudo[116102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a Aug 13 09:43:57 devstack sudo[116102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:57 devstack sudo[116099]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.info" returned: 0 in 0.306s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.312s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:57 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e021fcb0-573b-47b9-a325-9277489d7219 tempest-ProjectReaderTests-708195512 None] Create snapshot completed successfully Aug 13 09:43:57 devstack sudo[116102]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a" returned: 0 in 0.462s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:57 devstack sudo[116108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a Aug 13 09:43:57 devstack sudo[116108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:58 devstack sudo[116108]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41.07084307-8e44-479e-bc90-ee452156768a" returned: 0 in 0.272s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-07084307-8e44-479e-bc90-ee452156768a" released by "_delete_snapshot" :: held 1.763s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41" released by "delete_snapshot" :: held 1.787s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Created reservations ['7d5261ed-f003-49ff-92f7-9c16dcf9906d', 'd7bd8396-1e8d-479d-89b6-1ef141cc589d', 'db91db9b-1b94-4917-822d-d7842945b0c2', '2b2b05b9-eae7-4ce6-aaa4-ac60cd1996ca'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:58 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Delete snapshot completed successfully. Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d0cbb807-7fc6-46ff-8cc0-4bf0923c6fec tempest-ProjectMemberTests-1073032951 None] Lock "cinder-07084307-8e44-479e-bc90-ee452156768a-delete_snapshot" released by "delete_snapshot" :: held 1.959s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41" acquired by "delete_volume" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28e97bd-6fd1-4014-b7f0-86a0e9a55d61]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-9427c4ac-92ba-4e60-b028-5e2873e95ecb-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Lock "cinder-9427c4ac-92ba-4e60-b028-5e2873e95ecb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-quobyte-171c4cd3-5b09-4e56-9e74-be1ef9b91185" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-171c4cd3-5b09-4e56-9e74-be1ef9b91185" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-quobyte-9427c4ac-92ba-4e60-b028-5e2873e95ecb" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-9427c4ac-92ba-4e60-b028-5e2873e95ecb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:43:58 devstack sudo[116112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 Aug 13 09:43:58 devstack sudo[116112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Deleting offline snapshot 9427c4ac-92ba-4e60-b028-5e2873e95ecb of volume 171c4cd3-5b09-4e56-9e74-be1ef9b91185 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] snapshot_file for this snap is: volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a275357-392f-4e14-9be7-afbb33bd9ac4]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:58 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:59 devstack sudo[116114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb Aug 13 09:43:59 devstack sudo[116114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:59 devstack sudo[116112]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41" returned: 0 in 0.451s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:59 devstack sudo[116120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41 Aug 13 09:43:59 devstack sudo[116120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:59 devstack sudo[116114]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb" returned: 0 in 0.441s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[545152e3-2eb0-4b10-ab87-bef1aa3b4972]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Flow 'volume_create_manager' (65e30cd2-58cb-4374-87ac-6f4526e4344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4efbede5-dc84-40a8-b448-eb9cc47bf966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:59 devstack sudo[116120]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4efbede5-dc84-40a8-b448-eb9cc47bf966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1259232422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4c7764-9fb2-4c92-876c-450523122b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71156552c2d3444283a9bdceb38750ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:59Z,use_quota=True,user_id='de978a0de39248a3920b4d12fb0cf88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0d6069-2048-4c76-be20-e100ab78c659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0d6069-2048-4c76-be20-e100ab78c659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66c5891-f7a4-4d31-9cbb-7d7b6dd43388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66c5891-f7a4-4d31-9cbb-7d7b6dd43388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e4c7764-9fb2-4c92-876c-450523122b1d', 'volume_name': 'volume-4e4c7764-9fb2-4c92-876c-450523122b1d', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5a753f-9e25-4543-8c3e-d0951f2c8613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:59 devstack sudo[116125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 Aug 13 09:43:59 devstack sudo[116125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5a753f-9e25-4543-8c3e-d0951f2c8613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a833c12-b5cd-41e7-b108-e107585692d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:43:59 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Volume 4e4c7764-9fb2-4c92-876c-450523122b1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e4c7764-9fb2-4c92-876c-450523122b1d', 'volume_size': 1} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1259232422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4c7764-9fb2-4c92-876c-450523122b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71156552c2d3444283a9bdceb38750ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:43:59Z,use_quota=True,user_id='de978a0de39248a3920b4d12fb0cf88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Creating volume 4e4c7764-9fb2-4c92-876c-450523122b1d {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:43:59 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41" returned: 0 in 0.397s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41" released by "delete_volume" :: held 0.928s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:43:59 devstack sudo[116128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d 1073741824 Aug 13 09:43:59 devstack sudo[116128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Created reservations ['8e71328d-ba7d-4105-84e1-3098d8e3fed1', '7f107996-b84b-4195-a859-f509ae1dd3ed', '74d2d467-8704-49f9-9eee-0ccdda13d5e9', 'ea052972-5b11-4cbf-985f-8cc3dcaf6b40'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:59 devstack sudo[116130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:43:59 devstack sudo[116130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:43:59 devstack sudo[116125]: pam_unix(sudo:session): session closed for user root Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185" returned: 0 in 0.443s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:43:59 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:43:59 devstack sudo[116139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb Aug 13 09:43:59 devstack sudo[116139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:00 devstack sudo[116130]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.320s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:44:00 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Deleted volume successfully. Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e36c27fd-a6a2-4df0-bf57-b4cd48700268 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-b37af2ee-a22f-4c73-8fb8-5f7a83c08e41-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:00 devstack sudo[116128]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d 1073741824" returned: 0 in 0.558s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:00 devstack sudo[116146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d Aug 13 09:44:00 devstack sudo[116146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:00 devstack sudo[116139]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb" returned: 0 in 0.455s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:00 devstack sudo[116149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb Aug 13 09:44:00 devstack sudo[116149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (7763de0b-8e34-4e32-8074-4605fb10b3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8bdb08-caee-4331-87b7-6f5e85d59029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8bdb08-caee-4331-87b7-6f5e85d59029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721098110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721ff42d-00a1-45cf-bc01-7aa79826a884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:00Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bad40f2-b212-491e-99eb-717f79453c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bad40f2-b212-491e-99eb-717f79453c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765ddbfd-372b-4fac-93fa-b7c636975380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:00 devstack sudo[116146]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765ddbfd-372b-4fac-93fa-b7c636975380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '721ff42d-00a1-45cf-bc01-7aa79826a884', 'volume_name': 'volume-721ff42d-00a1-45cf-bc01-7aa79826a884', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd484e2-9b80-46ef-a8ea-c357b5a9f3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd484e2-9b80-46ef-a8ea-c357b5a9f3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38e0df2-ddd7-4dfe-8bb7-4b3fa555924f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:00 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Volume 721ff42d-00a1-45cf-bc01-7aa79826a884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-721ff42d-00a1-45cf-bc01-7aa79826a884', 'volume_size': 1} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d" returned: 0 in 0.320s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721098110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721ff42d-00a1-45cf-bc01-7aa79826a884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:00Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Creating volume 721ff42d-00a1-45cf-bc01-7aa79826a884 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:44:00 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a833c12-b5cd-41e7-b108-e107585692d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e4c7764-9fb2-4c92-876c-450523122b1d', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2554aaaf-cd7f-4a28-97d5-150a84973453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:00 devstack sudo[116152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884 1073741824 Aug 13 09:44:00 devstack sudo[116152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:00 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Volume volume-4e4c7764-9fb2-4c92-876c-450523122b1d (4e4c7764-9fb2-4c92-876c-450523122b1d): created successfully Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2554aaaf-cd7f-4a28-97d5-150a84973453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Flow 'volume_create_manager' (65e30cd2-58cb-4374-87ac-6f4526e4344b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:00 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-06497271-8b35-4e43-b132-34bb0f2ddfca tempest-SnapshotDependencyTests-558014531 None] Created volume successfully. Aug 13 09:44:00 devstack sudo[116149]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185.9427c4ac-92ba-4e60-b028-5e2873e95ecb" returned: 0 in 0.293s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-9427c4ac-92ba-4e60-b028-5e2873e95ecb" released by "_delete_snapshot" :: held 1.755s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-171c4cd3-5b09-4e56-9e74-be1ef9b91185" released by "delete_snapshot" :: held 1.783s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Created reservations ['b6f3e7ac-2c9d-4850-bcc8-4ff16c167e5a', '1ac2b565-f0e4-4362-a8fd-636b75e12f36', 'ecea6b10-e1c9-4d9d-afc5-8a8a623c81fd', '76601766-3f8b-4903-b86f-3cab33cefd67'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:00 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Delete snapshot completed successfully. Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b71f9738-b2d3-43d7-a4c4-ba4d59e6a259 tempest-ProjectReaderTests-708195512 None] Lock "cinder-9427c4ac-92ba-4e60-b028-5e2873e95ecb-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-171c4cd3-5b09-4e56-9e74-be1ef9b91185-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:00 devstack sudo[116152]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Lock "cinder-171c4cd3-5b09-4e56-9e74-be1ef9b91185-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:00 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884 1073741824" returned: 0 in 0.492s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-quobyte-171c4cd3-5b09-4e56-9e74-be1ef9b91185" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-171c4cd3-5b09-4e56-9e74-be1ef9b91185" acquired by "delete_volume" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:01 devstack sudo[116159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884 Aug 13 09:44:01 devstack sudo[116159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[343d3425-36e4-4a19-b3fd-67a1ee2b1cdc]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:01 devstack sudo[116161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 Aug 13 09:44:01 devstack sudo[116161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:01 devstack sudo[116159]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884" returned: 0 in 0.256s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38e0df2-ddd7-4dfe-8bb7-4b3fa555924f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-721ff42d-00a1-45cf-bc01-7aa79826a884', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc9e132-aa37-4c99-98a4-562d2069a92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:01 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Volume volume-721ff42d-00a1-45cf-bc01-7aa79826a884 (721ff42d-00a1-45cf-bc01-7aa79826a884): created successfully Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc9e132-aa37-4c99-98a4-562d2069a92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (7763de0b-8e34-4e32-8074-4605fb10b3a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:01 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-669fda11-8c80-448e-8a51-f4d63da5c797 tempest-ProjectMemberTests-1073032951 None] Created volume successfully. Aug 13 09:44:01 devstack sudo[116161]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185" returned: 0 in 0.430s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:01 devstack sudo[116167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185 Aug 13 09:44:01 devstack sudo[116167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] Creating offline snapshot 328def66-0ec3-46a1-8c2a-3e8fbf492f0e of volume 4e4c7764-9fb2-4c92-876c-450523122b1d {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[97980554-dcff-4d5a-98e2-b29439257a03]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:01 devstack sudo[116167]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-171c4cd3-5b09-4e56-9e74-be1ef9b91185" returned: 0 in 0.296s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-171c4cd3-5b09-4e56-9e74-be1ef9b91185" released by "delete_volume" :: held 0.793s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Created reservations ['1c8a3fcb-72df-4bae-a14d-bc2b01e5922f', '341b3e71-90d1-4b18-abc4-f82a8a1a1f9f', '35286411-4dad-4dc8-9f81-c87a455b8ae5', 'bf1ad74e-97c4-4b24-81dc-7ee002a1c239'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:01 devstack sudo[116170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d Aug 13 09:44:01 devstack sudo[116170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:01 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:01 devstack sudo[116172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:44:01 devstack sudo[116172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:02 devstack sudo[116170]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d" returned: 0 in 0.385s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:02 devstack sudo[116178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e 1G Aug 13 09:44:02 devstack sudo[116178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:02 devstack sudo[116172]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.274s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:02 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:44:02 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Deleted volume successfully. Aug 13 09:44:02 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-66703a91-98ee-4f15-89a9-e17dc0214704 tempest-ProjectReaderTests-708195512 None] Lock "cinder-171c4cd3-5b09-4e56-9e74-be1ef9b91185-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:02 devstack sudo[116178]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e 1G" returned: 0 in 0.533s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e4c7764-9fb2-4c92-876c-450523122b1d -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:02 devstack sudo[116184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e4c7764-9fb2-4c92-876c-450523122b1d -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e Aug 13 09:44:02 devstack sudo[116184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:02 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Flow 'volume_create_manager' (ed04cc1b-7b8f-4963-bbab-70b2b615eee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512d4351-a250-4a6a-95d3-b37ef336e834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:03 devstack sudo[116184]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e4c7764-9fb2-4c92-876c-450523122b1d -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e" returned: 0 in 0.351s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:03 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e is being set with open permissions: ugo+rw Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512d4351-a250-4a6a-95d3-b37ef336e834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899512916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53fc525-b58e-482f-96c0-e30a5e8ef529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc412bf921ed437295b0e3fc6f2b8df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:03Z,use_quota=True,user_id='ad66161a7dad4ad6be5a9a932989519e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfcc284-50ae-4b2f-a8a4-c680c066206d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:03 devstack sudo[116191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e Aug 13 09:44:03 devstack sudo[116191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfcc284-50ae-4b2f-a8a4-c680c066206d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1225d997-d9b9-4249-9d66-1cffa212dae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1225d997-d9b9-4249-9d66-1cffa212dae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c53fc525-b58e-482f-96c0-e30a5e8ef529', 'volume_name': 'volume-c53fc525-b58e-482f-96c0-e30a5e8ef529', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72980cd6-06c6-4f66-8638-6bc0c7756a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72980cd6-06c6-4f66-8638-6bc0c7756a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78bdb28f-990e-47f0-bc11-f30706aa3285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:03 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Volume c53fc525-b58e-482f-96c0-e30a5e8ef529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c53fc525-b58e-482f-96c0-e30a5e8ef529', 'volume_size': 1} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:03 devstack sudo[116191]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e" returned: 0 in 0.255s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:03 devstack sudo[116194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.info Aug 13 09:44:03 devstack sudo[116194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:03 devstack sudo[116194]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.info" returned: 0 in 0.278s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:03 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.info is being set with open permissions: ugo+rw Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:03 devstack sudo[116197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.info Aug 13 09:44:03 devstack sudo[116197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:03 devstack sudo[116197]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.info" returned: 0 in 0.260s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.154s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.946s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] Creating offline snapshot 139c0b99-aa51-46f5-9a0f-04f5e625fe65 of volume 721ff42d-00a1-45cf-bc01-7aa79826a884 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:44:03 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-36ec327f-0e06-47b2-96e3-39ec0d43b02e tempest-SnapshotDependencyTests-558014531 None] Create snapshot completed successfully Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[518f53c2-2b3e-47d7-8671-e674c69eab1d]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:03 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:04 devstack sudo[116200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884 Aug 13 09:44:04 devstack sudo[116200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:04 devstack sudo[116200]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884" returned: 0 in 0.405s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:04 devstack sudo[116206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65 1G Aug 13 09:44:04 devstack sudo[116206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:04 devstack sudo[116206]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65 1G" returned: 0 in 0.469s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:04 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-721ff42d-00a1-45cf-bc01-7aa79826a884 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:04 devstack sudo[116212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-721ff42d-00a1-45cf-bc01-7aa79826a884 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65 Aug 13 09:44:04 devstack sudo[116212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:05 devstack sudo[116212]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-721ff42d-00a1-45cf-bc01-7aa79826a884 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65" returned: 0 in 0.331s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:05 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65 is being set with open permissions: ugo+rw Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:05 devstack sudo[116218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65 Aug 13 09:44:05 devstack sudo[116218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:05 devstack sudo[116218]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65" returned: 0 in 0.285s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:05 devstack sudo[116221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.info Aug 13 09:44:05 devstack sudo[116221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Flow 'volume_create_manager' (02de6226-6874-499c-ba46-bed68170a98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e918c440-ce4c-4828-96a9-70f6d88af970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e918c440-ce4c-4828-96a9-70f6d88af970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a314f41-31ca-4570-8cd0-99e64791e94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71156552c2d3444283a9bdceb38750ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=328def66-0ec3-46a1-8c2a-3e8fbf492f0e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:05Z,use_quota=True,user_id='de978a0de39248a3920b4d12fb0cf88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ce48f5-e639-458d-b3e6-fdb4a44bf8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ce48f5-e639-458d-b3e6-fdb4a44bf8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b16989c-9fc2-41b9-819d-47709358694f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b16989c-9fc2-41b9-819d-47709358694f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a314f41-31ca-4570-8cd0-99e64791e94f', 'volume_name': 'volume-0a314f41-31ca-4570-8cd0-99e64791e94f', 'volume_size': 1, 'snapshot_id': '328def66-0ec3-46a1-8c2a-3e8fbf492f0e'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2622f234-891c-499e-b364-3ce29ba09158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2622f234-891c-499e-b364-3ce29ba09158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2034414-1ce7-454a-8b25-5df60b2b8488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:05 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Volume 0a314f41-31ca-4570-8cd0-99e64791e94f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a314f41-31ca-4570-8cd0-99e64791e94f', 'volume_size': 1, 'snapshot_id': '328def66-0ec3-46a1-8c2a-3e8fbf492f0e'} Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:05 devstack sudo[116221]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.info" returned: 0 in 0.267s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:05 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.info is being set with open permissions: ugo+rw Aug 13 09:44:05 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:05 devstack sudo[116224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.info Aug 13 09:44:05 devstack sudo[116224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:06 devstack sudo[116224]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.info" returned: 0 in 0.246s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.174s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.965s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899512916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53fc525-b58e-482f-96c0-e30a5e8ef529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc412bf921ed437295b0e3fc6f2b8df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:03Z,use_quota=True,user_id='ad66161a7dad4ad6be5a9a932989519e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Creating volume c53fc525-b58e-482f-96c0-e30a5e8ef529 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:44:06 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:06 devstack sudo[116227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 1073741824 Aug 13 09:44:06 devstack sudo[116227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:06 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-57bbc511-092c-4434-a1ce-54bf334f00e2 tempest-ProjectMemberTests-1073032951 None] Create snapshot completed successfully Aug 13 09:44:06 devstack sudo[116227]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 1073741824" returned: 0 in 0.459s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:06 devstack sudo[116233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 Aug 13 09:44:06 devstack sudo[116233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-139c0b99-aa51-46f5-9a0f-04f5e625fe65-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:06 devstack sudo[116233]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529" returned: 0 in 0.300s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Lock "cinder-139c0b99-aa51-46f5-9a0f-04f5e625fe65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-721ff42d-00a1-45cf-bc01-7aa79826a884" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.190s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "cinder-quobyte-328def66-0ec3-46a1-8c2a-3e8fbf492f0e-0a314f41-31ca-4570-8cd0-99e64791e94f" by "_create_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78bdb28f-990e-47f0-bc11-f30706aa3285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c53fc525-b58e-482f-96c0-e30a5e8ef529', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc6f9ca-e933-44c2-a2c8-2207aa2b54a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-721ff42d-00a1-45cf-bc01-7aa79826a884" acquired by "delete_snapshot" :: waited 0.047s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-139c0b99-aa51-46f5-9a0f-04f5e625fe65" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-quobyte-328def66-0ec3-46a1-8c2a-3e8fbf492f0e-0a314f41-31ca-4570-8cd0-99e64791e94f" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Creating volume 0a314f41-31ca-4570-8cd0-99e64791e94f from snapshot 328def66-0ec3-46a1-8c2a-3e8fbf492f0e {{(pid=94670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "cinder-quobyte-0a314f41-31ca-4570-8cd0-99e64791e94f" by "_copy_volume_from_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:06 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Volume volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 (c53fc525-b58e-482f-96c0-e30a5e8ef529): created successfully Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc6f9ca-e933-44c2-a2c8-2207aa2b54a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:06 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Flow 'volume_create_manager' (ed04cc1b-7b8f-4963-bbab-70b2b615eee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-139c0b99-aa51-46f5-9a0f-04f5e625fe65" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Deleting offline snapshot 139c0b99-aa51-46f5-9a0f-04f5e625fe65 of volume 721ff42d-00a1-45cf-bc01-7aa79826a884 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] snapshot_file for this snap is: volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-quobyte-0a314f41-31ca-4570-8cd0-99e64791e94f" acquired by "_copy_volume_from_snapshot" :: waited 0.063s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] snapshot: 328def66-0ec3-46a1-8c2a-3e8fbf492f0e, volume: 0a314f41-31ca-4570-8cd0-99e64791e94f, {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 13 09:44:07 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-bb4025c2-0dba-4952-963b-4e03a6a95a03 tempest-ProjectReaderTests-708195512 None] Created volume successfully. Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3668dfef-1af3-4845-8818-d01faf7f8f76]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[48643f26-1fa9-43ff-813e-61c00010f15f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:07 devstack sudo[116236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65 Aug 13 09:44:07 devstack sudo[116236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:07 devstack sudo[116237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e Aug 13 09:44:07 devstack sudo[116237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:07 devstack sudo[116236]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65" returned: 0 in 0.439s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-721ff42d-00a1-45cf-bc01-7aa79826a884(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:44:07 devstack sudo[116237]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e" returned: 0 in 0.422s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e4c7764-9fb2-4c92-876c-450523122b1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Creating direct copy from snapshot {{(pid=94670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a73571-685e-4847-a364-9e54fb4fcc72]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2e6e3e-f25a-4902-a2dd-5b7ed8de5576]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:07 devstack sudo[116247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d Aug 13 09:44:07 devstack sudo[116247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:07 devstack sudo[116246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884 Aug 13 09:44:07 devstack sudo[116246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:07 devstack sudo[116247]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d" returned: 0 in 0.385s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG cinder.utils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Path /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0a314f41-31ca-4570-8cd0-99e64791e94f not found in is_blk_device check {{(pid=94670) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 13 09:44:07 devstack sudo[116246]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0a314f41-31ca-4570-8cd0-99e64791e94f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884" returned: 0 in 0.418s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:07 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:07 devstack sudo[116256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0a314f41-31ca-4570-8cd0-99e64791e94f Aug 13 09:44:07 devstack sudo[116256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:08 devstack sudo[116257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65 Aug 13 09:44:08 devstack sudo[116257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:08 devstack sudo[116257]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65" returned: 0 in 0.442s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:08 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:08 devstack sudo[116268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65 Aug 13 09:44:08 devstack sudo[116268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:09 devstack sudo[116268]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:09 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884.139c0b99-aa51-46f5-9a0f-04f5e625fe65" returned: 0 in 0.859s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-139c0b99-aa51-46f5-9a0f-04f5e625fe65" released by "_delete_snapshot" :: held 2.331s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-721ff42d-00a1-45cf-bc01-7aa79826a884" released by "delete_snapshot" :: held 2.409s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:09 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Created reservations ['251b6c14-a927-42fe-ba7f-6339d22282b9', '60c0c7f0-9bf6-47c7-9dc1-17591e916ad2', '68800f60-5439-4169-bca7-95cd79509c30', '76c04046-41aa-446b-a38f-6c088fa0e292'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:09 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Delete snapshot completed successfully. Aug 13 09:44:09 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-4308701b-724d-4a7d-b534-1c193292f84f tempest-ProjectMemberTests-1073032951 None] Lock "cinder-139c0b99-aa51-46f5-9a0f-04f5e625fe65-delete_snapshot" released by "delete_snapshot" :: held 2.685s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-721ff42d-00a1-45cf-bc01-7aa79826a884-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-721ff42d-00a1-45cf-bc01-7aa79826a884-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-721ff42d-00a1-45cf-bc01-7aa79826a884" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:10 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-721ff42d-00a1-45cf-bc01-7aa79826a884" acquired by "delete_volume" :: waited 0.029s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:10 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb7c4d4-e70c-466d-aee6-e78003687cbb]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:10 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:10 devstack sudo[116278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884 Aug 13 09:44:10 devstack sudo[116278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:11 devstack sudo[116278]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884" returned: 0 in 0.696s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:11 devstack sudo[116284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884 Aug 13 09:44:11 devstack sudo[116284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:11 devstack sudo[116284]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:11 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-721ff42d-00a1-45cf-bc01-7aa79826a884" returned: 0 in 0.484s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:11 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-721ff42d-00a1-45cf-bc01-7aa79826a884" released by "delete_volume" :: held 1.322s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:11 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Created reservations ['4e531a47-73ab-42e3-afd9-c64f0067d1e0', 'be16a469-5e52-46c2-bc60-617f5255db1c', '0a84b68d-1897-486a-9599-42df77649e54', '12cbac6e-ad95-435b-a212-c57af9566978'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:12 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:12 devstack sudo[116287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:44:12 devstack sudo[116287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:12 devstack sudo[116287]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.511s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:12 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:44:12 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Deleted volume successfully. Aug 13 09:44:12 devstack sudo[116256]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0a314f41-31ca-4570-8cd0-99e64791e94f" returned: 0 in 4.694s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:12 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-a494eb53-bbd9-4ba0-93a5-fae5790fa644 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-721ff42d-00a1-45cf-bc01-7aa79826a884-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:12 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[128ee542-47db-4e0f-a9b6-1a430ab8d5c5]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:12 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:12 devstack sudo[116290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d Aug 13 09:44:12 devstack sudo[116290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:13 devstack sudo[116290]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d" returned: 0 in 0.614s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.image.image_utils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Image conversion details: src /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d, size 1024.00 MB, duration 4.70 sec, destination /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0a314f41-31ca-4570-8cd0-99e64791e94f {{(pid=94670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 13 09:44:13 devstack cinder-volume[94670]: INFO cinder.image.image_utils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Converted 1024.00 MB image at 218.10 MB/s Aug 13 09:44:13 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0a314f41-31ca-4570-8cd0-99e64791e94f is being set with open permissions: ugo+rw Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0a314f41-31ca-4570-8cd0-99e64791e94f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:13 devstack sudo[116297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0a314f41-31ca-4570-8cd0-99e64791e94f Aug 13 09:44:13 devstack sudo[116297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (991ac055-35ad-438c-845f-1296bc280921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ab0b49-a590-477a-9633-f06a756f460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ab0b49-a590-477a-9633-f06a756f460d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1558123573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30372de4-4a52-45b3-a914-5a3cc45db315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:13Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5fd9f3-857e-4e24-ba6c-495b04493b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5fd9f3-857e-4e24-ba6c-495b04493b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7cdf95-6d76-431c-98e2-f2c189e88839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7cdf95-6d76-431c-98e2-f2c189e88839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30372de4-4a52-45b3-a914-5a3cc45db315', 'volume_name': 'volume-30372de4-4a52-45b3-a914-5a3cc45db315', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6fde13-30db-4a53-b4c9-4e8a87f09676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6fde13-30db-4a53-b4c9-4e8a87f09676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967a090d-d7bc-4832-9887-14f1c9227156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:13 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Volume 30372de4-4a52-45b3-a914-5a3cc45db315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30372de4-4a52-45b3-a914-5a3cc45db315', 'volume_size': 1} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:13 devstack sudo[116297]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0a314f41-31ca-4570-8cd0-99e64791e94f" returned: 0 in 0.258s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-quobyte-0a314f41-31ca-4570-8cd0-99e64791e94f" released by "_copy_volume_from_snapshot" :: held 6.508s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-quobyte-328def66-0ec3-46a1-8c2a-3e8fbf492f0e-0a314f41-31ca-4570-8cd0-99e64791e94f" released by "_create_volume_from_snapshot" :: held 6.587s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.641s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.231s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] Creating offline snapshot 08bbf761-892a-4b40-bf06-3413cf36fdcf of volume c53fc525-b58e-482f-96c0-e30a5e8ef529 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2034414-1ce7-454a-8b25-5df60b2b8488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a314f41-31ca-4570-8cd0-99e64791e94f', 'volume_size': 1, 'snapshot_id': '328def66-0ec3-46a1-8c2a-3e8fbf492f0e'}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1b42bc-5dbe-4e46-b4c5-b8de6f8ccf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e66d0c8-585d-4298-90f4-0d4dbcdffb69]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:13 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Volume volume-0a314f41-31ca-4570-8cd0-99e64791e94f (0a314f41-31ca-4570-8cd0-99e64791e94f): created successfully Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1b42bc-5dbe-4e46-b4c5-b8de6f8ccf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Flow 'volume_create_manager' (02de6226-6874-499c-ba46-bed68170a98c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:13 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-48068b6e-7517-428f-b2ae-cd7b014c8f0f tempest-SnapshotDependencyTests-558014531 None] Created volume successfully. Aug 13 09:44:13 devstack sudo[116300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 Aug 13 09:44:13 devstack sudo[116300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:13 devstack sudo[116300]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529" returned: 0 in 0.378s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:13 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:14 devstack sudo[116305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf 1G Aug 13 09:44:14 devstack sudo[116305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "cinder-328def66-0ec3-46a1-8c2a-3e8fbf492f0e-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-328def66-0ec3-46a1-8c2a-3e8fbf492f0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "cinder-quobyte-4e4c7764-9fb2-4c92-876c-450523122b1d" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:14 devstack sudo[116305]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf 1G" returned: 0 in 0.465s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-quobyte-4e4c7764-9fb2-4c92-876c-450523122b1d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "cinder-quobyte-328def66-0ec3-46a1-8c2a-3e8fbf492f0e" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-quobyte-328def66-0ec3-46a1-8c2a-3e8fbf492f0e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:14 devstack sudo[116312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf Aug 13 09:44:14 devstack sudo[116312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Deleting offline snapshot 328def66-0ec3-46a1-8c2a-3e8fbf492f0e of volume 4e4c7764-9fb2-4c92-876c-450523122b1d {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] snapshot_file for this snap is: volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd80d14-29dc-4e15-b8d2-64a78c95152f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:14 devstack sudo[116314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e Aug 13 09:44:14 devstack sudo[116314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:14 devstack sudo[116312]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf" returned: 0 in 0.324s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:14 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf is being set with open permissions: ugo+rw Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:14 devstack sudo[116319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf Aug 13 09:44:14 devstack sudo[116319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:14 devstack sudo[116314]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e" returned: 0 in 0.398s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e4c7764-9fb2-4c92-876c-450523122b1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b5a35c-9510-4d36-9040-e5341bf810b1]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:14 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:15 devstack sudo[116319]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf" returned: 0 in 0.266s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:15 devstack sudo[116324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d Aug 13 09:44:15 devstack sudo[116324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:15 devstack sudo[116327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.info Aug 13 09:44:15 devstack sudo[116327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:15 devstack sudo[116327]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:15 devstack sudo[116324]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.info" returned: 0 in 0.283s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:15 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.info is being set with open permissions: ugo+rw Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d" returned: 0 in 0.421s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:15 devstack sudo[116333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.info Aug 13 09:44:15 devstack sudo[116333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:15 devstack sudo[116334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e Aug 13 09:44:15 devstack sudo[116334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:15 devstack sudo[116333]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.info" returned: 0 in 0.275s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.266s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1558123573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30372de4-4a52-45b3-a914-5a3cc45db315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:13Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Creating volume 30372de4-4a52-45b3-a914-5a3cc45db315 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:44:15 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:15 devstack sudo[116341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315 1073741824 Aug 13 09:44:15 devstack sudo[116341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:15 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e2252ebd-3b49-4204-9635-bed64fe0a780 tempest-ProjectReaderTests-708195512 None] Create snapshot completed successfully Aug 13 09:44:15 devstack sudo[116334]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e" returned: 0 in 0.395s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:15 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:15 devstack sudo[116343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e Aug 13 09:44:15 devstack sudo[116343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:16 devstack sudo[116343]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d.328def66-0ec3-46a1-8c2a-3e8fbf492f0e" returned: 0 in 0.289s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-quobyte-328def66-0ec3-46a1-8c2a-3e8fbf492f0e" released by "_delete_snapshot" :: held 1.611s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-quobyte-4e4c7764-9fb2-4c92-876c-450523122b1d" released by "delete_snapshot" :: held 1.638s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:16 devstack sudo[116341]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315 1073741824" returned: 0 in 0.449s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:16 devstack sudo[116349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315 Aug 13 09:44:16 devstack sudo[116349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Created reservations ['3f72308c-21fe-4665-a3a5-7d757592cd4e', '2074c0e0-d123-47e8-83c6-ec5eda1fe403', '5fe96895-3cdd-47f5-b41e-14e3f5b09729', '8e130a57-d95f-4cea-8db0-a60cd22051eb'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:16 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Delete snapshot completed successfully. Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-2dce6841-31ee-4884-a0ae-fee65e500d22 tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-328def66-0ec3-46a1-8c2a-3e8fbf492f0e-delete_snapshot" released by "delete_snapshot" :: held 1.848s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:16 devstack sudo[116349]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315" returned: 0 in 0.265s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967a090d-d7bc-4832-9887-14f1c9227156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30372de4-4a52-45b3-a914-5a3cc45db315', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61064af9-b8da-4896-b89e-d8fe1b2b3168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:16 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Volume volume-30372de4-4a52-45b3-a914-5a3cc45db315 (30372de4-4a52-45b3-a914-5a3cc45db315): created successfully Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61064af9-b8da-4896-b89e-d8fe1b2b3168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (991ac055-35ad-438c-845f-1296bc280921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:16 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d3c565f9-0ff2-415b-820d-16ebd8331979 tempest-ProjectMemberTests-1073032951 None] Created volume successfully. Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "cinder-4e4c7764-9fb2-4c92-876c-450523122b1d-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-4e4c7764-9fb2-4c92-876c-450523122b1d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "cinder-quobyte-4e4c7764-9fb2-4c92-876c-450523122b1d" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-quobyte-4e4c7764-9fb2-4c92-876c-450523122b1d" acquired by "delete_volume" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0543f07-d467-4e02-bf17-850550005a34]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:16 devstack sudo[116352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d Aug 13 09:44:16 devstack sudo[116352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-08bbf761-892a-4b40-bf06-3413cf36fdcf-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Lock "cinder-08bbf761-892a-4b40-bf06-3413cf36fdcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-quobyte-c53fc525-b58e-482f-96c0-e30a5e8ef529" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-c53fc525-b58e-482f-96c0-e30a5e8ef529" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-quobyte-08bbf761-892a-4b40-bf06-3413cf36fdcf" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-08bbf761-892a-4b40-bf06-3413cf36fdcf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Deleting offline snapshot 08bbf761-892a-4b40-bf06-3413cf36fdcf of volume c53fc525-b58e-482f-96c0-e30a5e8ef529 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] snapshot_file for this snap is: volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f24bf8-e88a-4255-a8a7-80ab95bc01d5]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:16 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:17 devstack sudo[116354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf Aug 13 09:44:17 devstack sudo[116354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:17 devstack sudo[116352]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d" returned: 0 in 0.403s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:17 devstack sudo[116359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d Aug 13 09:44:17 devstack sudo[116359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:17 devstack sudo[116354]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf" returned: 0 in 0.380s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c53fc525-b58e-482f-96c0-e30a5e8ef529(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f9cc5c-8011-4758-bd7f-475622455ecb]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:17 devstack sudo[116359]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-4e4c7764-9fb2-4c92-876c-450523122b1d" returned: 0 in 0.273s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-quobyte-4e4c7764-9fb2-4c92-876c-450523122b1d" released by "delete_volume" :: held 0.737s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Created reservations ['bcd61066-90c3-4b4d-a32b-e0b28f6c9454', 'd6a0af7e-6d3d-4c14-8c5d-b1a969793c8c', 'a0a3a9ad-cae9-4483-b2d2-d5ab23867af5', 'fb92faae-a820-4b8a-8c5d-5dc7f8767f19'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:17 devstack sudo[116365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 Aug 13 09:44:17 devstack sudo[116365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:17 devstack sudo[116367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:44:17 devstack sudo[116367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "cinder-0a314f41-31ca-4570-8cd0-99e64791e94f-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] Creating offline snapshot 27cc87b6-e8de-4bca-b31a-5037d85f1b20 of volume 30372de4-4a52-45b3-a914-5a3cc45db315 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:44:17 devstack sudo[116365]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529" returned: 0 in 0.493s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9148ba0c-4922-4a3e-a6ff-fab7d338c55b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-0a314f41-31ca-4570-8cd0-99e64791e94f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:17 devstack sudo[116373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf Aug 13 09:44:17 devstack sudo[116373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "cinder-quobyte-0a314f41-31ca-4570-8cd0-99e64791e94f" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:17 devstack sudo[116367]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-quobyte-0a314f41-31ca-4570-8cd0-99e64791e94f" acquired by "delete_volume" :: waited 0.022s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.396s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:44:17 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Deleted volume successfully. Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[103c54b8-6b7b-4fa9-9b5e-46be4055271b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0a314f41-31ca-4570-8cd0-99e64791e94f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:17 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-b205496d-48fa-4f06-a699-27d67f22d213 tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-4e4c7764-9fb2-4c92-876c-450523122b1d-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:18 devstack sudo[116375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315 Aug 13 09:44:18 devstack sudo[116375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:18 devstack sudo[116377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0a314f41-31ca-4570-8cd0-99e64791e94f Aug 13 09:44:18 devstack sudo[116377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:18 devstack sudo[116373]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf" returned: 0 in 0.414s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:18 devstack sudo[116386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf Aug 13 09:44:18 devstack sudo[116386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:18 devstack sudo[116375]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315" returned: 0 in 0.450s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:18 devstack sudo[116388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20 1G Aug 13 09:44:18 devstack sudo[116388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:18 devstack sudo[116377]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0a314f41-31ca-4570-8cd0-99e64791e94f" returned: 0 in 0.427s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0a314f41-31ca-4570-8cd0-99e64791e94f {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:18 devstack sudo[116393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0a314f41-31ca-4570-8cd0-99e64791e94f Aug 13 09:44:18 devstack sudo[116393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:18 devstack sudo[116386]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529.08bbf761-892a-4b40-bf06-3413cf36fdcf" returned: 0 in 0.280s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-08bbf761-892a-4b40-bf06-3413cf36fdcf" released by "_delete_snapshot" :: held 1.668s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-c53fc525-b58e-482f-96c0-e30a5e8ef529" released by "delete_snapshot" :: held 1.695s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Created reservations ['f65b364b-f911-4b3e-9da8-72814941776c', '4fef6b0b-b905-4696-aa0d-7c5549553524', 'd13808cb-95af-48fc-a241-15dbe82cbb1f', '26cf79e3-0893-44f6-a1fa-591ccf8f6ea8'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:18 devstack sudo[116393]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-0a314f41-31ca-4570-8cd0-99e64791e94f" returned: 0 in 0.289s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-quobyte-0a314f41-31ca-4570-8cd0-99e64791e94f" released by "delete_volume" :: held 0.776s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:18 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Delete snapshot completed successfully. Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e7d39391-603b-4de2-81b2-4d38f38c983e tempest-ProjectReaderTests-708195512 None] Lock "cinder-08bbf761-892a-4b40-bf06-3413cf36fdcf-delete_snapshot" released by "delete_snapshot" :: held 1.884s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Created reservations ['fe6de2cd-3864-47ba-9923-26b142da6eaf', 'eb592d42-8f93-4fd2-8cb7-91984ddccd7e', 'cbaed946-c6c2-488c-8e65-97d4e7916cf2', '3985b855-9d76-4f94-a98b-4de43b7766f1'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:18 devstack sudo[116388]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20 1G" returned: 0 in 0.486s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30372de4-4a52-45b3-a914-5a3cc45db315 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:18 devstack sudo[116401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30372de4-4a52-45b3-a914-5a3cc45db315 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20 Aug 13 09:44:18 devstack sudo[116401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:18 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:18 devstack sudo[116403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:44:18 devstack sudo[116403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-c53fc525-b58e-482f-96c0-e30a5e8ef529-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Lock "cinder-c53fc525-b58e-482f-96c0-e30a5e8ef529-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-quobyte-c53fc525-b58e-482f-96c0-e30a5e8ef529" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-c53fc525-b58e-482f-96c0-e30a5e8ef529" acquired by "delete_volume" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:19 devstack sudo[116401]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30372de4-4a52-45b3-a914-5a3cc45db315 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20" returned: 0 in 0.410s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:19 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20 is being set with open permissions: ugo+rw Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d47ed8a-e0e4-455a-bae9-be52998d4e1b]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:19 devstack sudo[116403]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.363s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:44:19 devstack sudo[116409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20 Aug 13 09:44:19 devstack sudo[116409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:19 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Deleted volume successfully. Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e461406f-8ea7-44ef-9fcf-99c02ac419f7 tempest-SnapshotDependencyTests-558014531 None] Lock "cinder-0a314f41-31ca-4570-8cd0-99e64791e94f-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:19 devstack sudo[116410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 Aug 13 09:44:19 devstack sudo[116410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:19 devstack sudo[116409]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20" returned: 0 in 0.310s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:19 devstack sudo[116414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.info Aug 13 09:44:19 devstack sudo[116414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:19 devstack sudo[116410]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529" returned: 0 in 0.458s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:19 devstack sudo[116419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529 Aug 13 09:44:19 devstack sudo[116419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:19 devstack sudo[116414]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.info" returned: 0 in 0.273s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:19 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.info is being set with open permissions: ugo+rw Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:19 devstack sudo[116422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.info Aug 13 09:44:19 devstack sudo[116422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:19 devstack sudo[116419]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-c53fc525-b58e-482f-96c0-e30a5e8ef529" returned: 0 in 0.273s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:19 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-c53fc525-b58e-482f-96c0-e30a5e8ef529" released by "delete_volume" :: held 0.813s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Created reservations ['8746a310-db14-48f1-9837-7cdd0eaa01f5', 'e3ef2633-114d-4dde-aae1-e4a213aadfa6', '36aff910-3f0e-4ae4-8ff5-bd97dc05c7fe', '764c1a18-4879-48f1-8a54-556da5d93d7b'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:20 devstack sudo[116427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:44:20 devstack sudo[116427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:20 devstack sudo[116422]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.info" returned: 0 in 0.358s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:20 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-7b9ce595-31e5-4c9f-99eb-d17a0a465e30 tempest-ProjectMemberTests-1073032951 None] Create snapshot completed successfully Aug 13 09:44:20 devstack sudo[116427]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.269s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:44:20 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Deleted volume successfully. Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-71f567cf-df83-4cf2-83cd-0e0b9febc84c tempest-ProjectReaderTests-708195512 None] Lock "cinder-c53fc525-b58e-482f-96c0-e30a5e8ef529-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Flow 'volume_create_manager' (42f6e3aa-f2e2-4d14-8ae3-cf35a108e134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681ba834-d0de-48ad-bf40-afc50042bca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681ba834-d0de-48ad-bf40-afc50042bca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1225168172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219c46cf-eb9e-4a4e-9a8f-8e130671afc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc412bf921ed437295b0e3fc6f2b8df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:21Z,use_quota=True,user_id='ad66161a7dad4ad6be5a9a932989519e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85eb7b21-2f8b-4727-a71b-bafd1a5b92dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85eb7b21-2f8b-4727-a71b-bafd1a5b92dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f426347f-cbe9-477a-bd16-48afd9de1c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f426347f-cbe9-477a-bd16-48afd9de1c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '219c46cf-eb9e-4a4e-9a8f-8e130671afc0', 'volume_name': 'volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d50c3d7-b2c3-45ac-aec4-34d53d448229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d50c3d7-b2c3-45ac-aec4-34d53d448229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2fc36a9-1eca-404c-bb60-5aaf11134cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:20 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Volume 219c46cf-eb9e-4a4e-9a8f-8e130671afc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0', 'volume_size': 1} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1225168172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219c46cf-eb9e-4a4e-9a8f-8e130671afc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc412bf921ed437295b0e3fc6f2b8df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:21Z,use_quota=True,user_id='ad66161a7dad4ad6be5a9a932989519e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Creating volume 219c46cf-eb9e-4a4e-9a8f-8e130671afc0 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:44:20 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:44:20 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:20 devstack sudo[116433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 1073741824 Aug 13 09:44:20 devstack sudo[116433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-27cc87b6-e8de-4bca-b31a-5037d85f1b20-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Lock "cinder-27cc87b6-e8de-4bca-b31a-5037d85f1b20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-30372de4-4a52-45b3-a914-5a3cc45db315" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-30372de4-4a52-45b3-a914-5a3cc45db315" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-27cc87b6-e8de-4bca-b31a-5037d85f1b20" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-27cc87b6-e8de-4bca-b31a-5037d85f1b20" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Deleting offline snapshot 27cc87b6-e8de-4bca-b31a-5037d85f1b20 of volume 30372de4-4a52-45b3-a914-5a3cc45db315 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] snapshot_file for this snap is: volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96b9594-2435-481d-be53-be26883e2f7e]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:21 devstack sudo[116435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20 Aug 13 09:44:21 devstack sudo[116435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:21 devstack sudo[116433]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 1073741824" returned: 0 in 0.516s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:21 devstack sudo[116441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 Aug 13 09:44:21 devstack sudo[116441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:21 devstack sudo[116435]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20" returned: 0 in 0.422s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30372de4-4a52-45b3-a914-5a3cc45db315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4997c45-b6f3-4e33-9dd6-21a7e28f22b5]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:21 devstack sudo[116446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315 Aug 13 09:44:21 devstack sudo[116446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:21 devstack sudo[116441]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0" returned: 0 in 0.288s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2fc36a9-1eca-404c-bb60-5aaf11134cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782fa998-31bd-43bf-b97f-ea95d74fdf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:21 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Volume volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 (219c46cf-eb9e-4a4e-9a8f-8e130671afc0): created successfully Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782fa998-31bd-43bf-b97f-ea95d74fdf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:21 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Flow 'volume_create_manager' (42f6e3aa-f2e2-4d14-8ae3-cf35a108e134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:21 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-994d340c-26f9-4601-8e1a-b5ed38f09512 tempest-ProjectReaderTests-708195512 None] Created volume successfully. Aug 13 09:44:22 devstack sudo[116446]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315" returned: 0 in 0.430s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:22 devstack sudo[116452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20 Aug 13 09:44:22 devstack sudo[116452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:22 devstack sudo[116452]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20" returned: 0 in 0.371s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:22 devstack sudo[116457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20 Aug 13 09:44:22 devstack sudo[116457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:22 devstack sudo[116457]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:22 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315.27cc87b6-e8de-4bca-b31a-5037d85f1b20" returned: 0 in 0.243s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-27cc87b6-e8de-4bca-b31a-5037d85f1b20" released by "_delete_snapshot" :: held 1.574s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-30372de4-4a52-45b3-a914-5a3cc45db315" released by "delete_snapshot" :: held 1.597s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:22 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Created reservations ['74d91e88-e006-4779-98f1-38dd1014cd78', '2dd83e10-68cc-426b-a9f9-5a353328b792', 'f524bba0-a23d-4e46-9fc5-b334eeceb4ce', '3bc1da15-09fc-4380-bdb8-31a6c900d894'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:22 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Delete snapshot completed successfully. Aug 13 09:44:22 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-86a12741-6496-4eec-9659-e91a63c5550f tempest-ProjectMemberTests-1073032951 None] Lock "cinder-27cc87b6-e8de-4bca-b31a-5037d85f1b20-delete_snapshot" released by "delete_snapshot" :: held 1.738s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-30372de4-4a52-45b3-a914-5a3cc45db315-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-30372de4-4a52-45b3-a914-5a3cc45db315-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:23 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] Creating offline snapshot 52499f15-b7cf-448a-9d52-91b38dcea8d2 of volume 219c46cf-eb9e-4a4e-9a8f-8e130671afc0 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:44:23 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d1ef28-e399-4192-b3e2-2e70945b88ec]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-30372de4-4a52-45b3-a914-5a3cc45db315" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:23 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-30372de4-4a52-45b3-a914-5a3cc45db315" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:23 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[342e56bc-04aa-467f-b24e-ed33636aa4ea]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:23 devstack sudo[116462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 Aug 13 09:44:23 devstack sudo[116462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:23 devstack sudo[116463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315 Aug 13 09:44:23 devstack sudo[116463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:23 devstack sudo[116462]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0" returned: 0 in 0.408s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:23 devstack sudo[116469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2 1G Aug 13 09:44:23 devstack sudo[116469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:23 devstack sudo[116463]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315" returned: 0 in 0.439s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:23 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:23 devstack sudo[116474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315 Aug 13 09:44:23 devstack sudo[116474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:24 devstack sudo[116474]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-30372de4-4a52-45b3-a914-5a3cc45db315" returned: 0 in 0.302s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-30372de4-4a52-45b3-a914-5a3cc45db315" released by "delete_volume" :: held 0.812s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:24 devstack sudo[116469]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2 1G" returned: 0 in 0.496s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:24 devstack sudo[116485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2 Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Created reservations ['b182bcc0-ac0e-4b02-976e-707e1a37206d', '75291a86-dd91-42ef-b4bb-94132d32269c', '011d59c1-083c-44cc-9d3c-7d20ec564a60', '2cf7fa51-f19d-4161-a5b3-fe6de36d7969'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:24 devstack sudo[116485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:24 devstack sudo[116487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:44:24 devstack sudo[116487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:24 devstack sudo[116485]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2" returned: 0 in 0.462s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:24 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2 is being set with open permissions: ugo+rw Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:24 devstack sudo[116494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2 Aug 13 09:44:24 devstack sudo[116494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:24 devstack sudo[116487]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.334s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:44:24 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Deleted volume successfully. Aug 13 09:44:24 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e2fdab0a-f4be-4da3-ad12-d831cee24dd1 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-30372de4-4a52-45b3-a914-5a3cc45db315-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:25 devstack sudo[116494]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2" returned: 0 in 0.323s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:25 devstack sudo[116497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.info Aug 13 09:44:25 devstack sudo[116497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (996a0bb0-9e47-4497-8e15-c89ea6667978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c141302-ffbf-4c7f-9bb5-2c5fe003a233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c141302-ffbf-4c7f-9bb5-2c5fe003a233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-835229585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1129f219-fd37-4bc1-bf98-b842af088be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:25Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddbb556-54aa-42fd-b9e4-ede46cb9df30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddbb556-54aa-42fd-b9e4-ede46cb9df30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e2aba3a-f0ce-492c-83c7-15348d3ccbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e2aba3a-f0ce-492c-83c7-15348d3ccbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1129f219-fd37-4bc1-bf98-b842af088be7', 'volume_name': 'volume-1129f219-fd37-4bc1-bf98-b842af088be7', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63981b80-127e-440e-adcd-8e60869c1367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63981b80-127e-440e-adcd-8e60869c1367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c297623-4dd9-47fc-89ce-cb1ca0f39874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:25 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Volume 1129f219-fd37-4bc1-bf98-b842af088be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1129f219-fd37-4bc1-bf98-b842af088be7', 'volume_size': 1} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:25 devstack sudo[116497]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.info" returned: 0 in 0.291s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:25 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.info is being set with open permissions: ugo+rw Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:25 devstack sudo[116500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.info Aug 13 09:44:25 devstack sudo[116500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:25 devstack sudo[116500]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.info" returned: 0 in 0.264s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.396s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-835229585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1129f219-fd37-4bc1-bf98-b842af088be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:25Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Creating volume 1129f219-fd37-4bc1-bf98-b842af088be7 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:44:25 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:25 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:UPDATE=220,cinder:DELETE=16,cinder:SELECT=164,cinder:INSERT=60 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:44:25 devstack sudo[116503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7 1073741824 Aug 13 09:44:25 devstack sudo[116503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:25 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-ff3469b5-cb4d-4999-a820-d94faf830c91 tempest-ProjectReaderTests-708195512 None] Create snapshot completed successfully Aug 13 09:44:26 devstack sudo[116503]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7 1073741824" returned: 0 in 0.513s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=170,cinder:INSERT=53,cinder:UPDATE=198,cinder:DELETE=20 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:26 devstack sudo[116509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7 Aug 13 09:44:26 devstack sudo[116509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-52499f15-b7cf-448a-9d52-91b38dcea8d2-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Lock "cinder-52499f15-b7cf-448a-9d52-91b38dcea8d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-quobyte-219c46cf-eb9e-4a4e-9a8f-8e130671afc0" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-219c46cf-eb9e-4a4e-9a8f-8e130671afc0" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-quobyte-52499f15-b7cf-448a-9d52-91b38dcea8d2" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-52499f15-b7cf-448a-9d52-91b38dcea8d2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Deleting offline snapshot 52499f15-b7cf-448a-9d52-91b38dcea8d2 of volume 219c46cf-eb9e-4a4e-9a8f-8e130671afc0 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] snapshot_file for this snap is: volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:44:26 devstack sudo[116509]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7" returned: 0 in 0.299s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d189212-1584-4d21-9c8f-46e738a29cae]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c297623-4dd9-47fc-89ce-cb1ca0f39874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1129f219-fd37-4bc1-bf98-b842af088be7', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827e4d0a-cd51-4e8d-8518-1686c173c0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:26 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Volume volume-1129f219-fd37-4bc1-bf98-b842af088be7 (1129f219-fd37-4bc1-bf98-b842af088be7): created successfully Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827e4d0a-cd51-4e8d-8518-1686c173c0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (996a0bb0-9e47-4497-8e15-c89ea6667978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:26 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-3cf5ba1a-b196-4d2e-87c4-51c25ac39209 tempest-ProjectMemberTests-1073032951 None] Created volume successfully. Aug 13 09:44:26 devstack sudo[116512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2 Aug 13 09:44:26 devstack sudo[116512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:26 devstack sudo[116512]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2" returned: 0 in 0.388s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[371091c8-682d-4538-aa62-1646a12133aa]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:26 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:27 devstack sudo[116517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 Aug 13 09:44:27 devstack sudo[116517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:27 devstack sudo[116517]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0" returned: 0 in 0.407s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:27 devstack sudo[116523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2 Aug 13 09:44:27 devstack sudo[116523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:27 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] Creating offline snapshot 15e14642-b420-4d58-80bd-1a1523928ed5 of volume 1129f219-fd37-4bc1-bf98-b842af088be7 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:44:27 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[821ea383-a54c-4a7d-9c91-e74110efc37d]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:27 devstack sudo[116525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7 Aug 13 09:44:27 devstack sudo[116525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:27 devstack sudo[116523]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2" returned: 0 in 0.370s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:27 devstack sudo[116530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2 Aug 13 09:44:27 devstack sudo[116530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:27 devstack sudo[116525]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7" returned: 0 in 0.390s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:27 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:27 devstack sudo[116535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5 1G Aug 13 09:44:27 devstack sudo[116535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:28 devstack sudo[116530]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0.52499f15-b7cf-448a-9d52-91b38dcea8d2" returned: 0 in 0.284s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-52499f15-b7cf-448a-9d52-91b38dcea8d2" released by "_delete_snapshot" :: held 1.584s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-219c46cf-eb9e-4a4e-9a8f-8e130671afc0" released by "delete_snapshot" :: held 1.611s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:28 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Created reservations ['806a4647-9a5f-4d4a-91d2-81d8ca929e1b', 'e895bb99-b32f-46ab-a62c-dae3d58daeb7', 'dd49ce12-49f4-47e3-bc01-57cb5afbc78c', 'b64df1f0-e801-47d5-8f70-1fbb56d6735c'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:28 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Delete snapshot completed successfully. Aug 13 09:44:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bf50e0a7-c233-4f82-b423-e1e3b3d0d473 tempest-ProjectReaderTests-708195512 None] Lock "cinder-52499f15-b7cf-448a-9d52-91b38dcea8d2-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:28 devstack sudo[116535]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5 1G" returned: 0 in 0.549s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1129f219-fd37-4bc1-bf98-b842af088be7 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:28 devstack sudo[116543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1129f219-fd37-4bc1-bf98-b842af088be7 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5 Aug 13 09:44:28 devstack sudo[116543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-219c46cf-eb9e-4a4e-9a8f-8e130671afc0-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Lock "cinder-219c46cf-eb9e-4a4e-9a8f-8e130671afc0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-quobyte-219c46cf-eb9e-4a4e-9a8f-8e130671afc0" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:28 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-219c46cf-eb9e-4a4e-9a8f-8e130671afc0" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:28 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f640b033-2522-4136-a746-98a1d589462e]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:28 devstack sudo[116543]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1129f219-fd37-4bc1-bf98-b842af088be7 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5" returned: 0 in 0.331s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:28 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5 is being set with open permissions: ugo+rw Aug 13 09:44:28 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:28 devstack sudo[116549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5 Aug 13 09:44:28 devstack sudo[116549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:28 devstack sudo[116548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 Aug 13 09:44:28 devstack sudo[116548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:29 devstack sudo[116549]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5" returned: 0 in 0.276s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:29 devstack sudo[116555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.info Aug 13 09:44:29 devstack sudo[116555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:29 devstack sudo[116548]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0" returned: 0 in 0.415s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:29 devstack sudo[116558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0 Aug 13 09:44:29 devstack sudo[116558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:29 devstack sudo[116555]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.info" returned: 0 in 0.311s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:29 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.info is being set with open permissions: ugo+rw Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:29 devstack sudo[116562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.info Aug 13 09:44:29 devstack sudo[116562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:29 devstack sudo[116558]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-219c46cf-eb9e-4a4e-9a8f-8e130671afc0" returned: 0 in 0.307s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-219c46cf-eb9e-4a4e-9a8f-8e130671afc0" released by "delete_volume" :: held 0.787s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Created reservations ['bfabb5e8-a19b-4fa6-8f2b-17bed56cece6', '2c6477b6-d082-4008-b174-de387739834f', 'fdc62e7f-ed28-467f-8cd9-cc573ecb1342', '61c94248-c916-40de-895b-56fe8d96f6c8'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:29 devstack sudo[116562]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.info" returned: 0 in 0.268s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:29 devstack sudo[116566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:44:29 devstack sudo[116566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:29 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-83edcba8-7494-4d3d-9b5a-0dfc50c4fcff tempest-ProjectMemberTests-1073032951 None] Create snapshot completed successfully Aug 13 09:44:29 devstack sudo[116566]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.287s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:44:29 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Deleted volume successfully. Aug 13 09:44:29 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d1c385a3-d738-4243-b969-34d538ff84f0 tempest-ProjectReaderTests-708195512 None] Lock "cinder-219c46cf-eb9e-4a4e-9a8f-8e130671afc0-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Flow 'volume_create_manager' (263f5339-1932-4cba-b71b-b23113d9c811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6a8ba8-10ed-4657-9777-d13443371a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6a8ba8-10ed-4657-9777-d13443371a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1408529327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7c6931-3e2e-497e-89ac-9ff369a99a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc412bf921ed437295b0e3fc6f2b8df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:30Z,use_quota=True,user_id='ad66161a7dad4ad6be5a9a932989519e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02680e1d-a44d-42d2-b553-e5704bf00d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02680e1d-a44d-42d2-b553-e5704bf00d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4cf64c-ca3d-4504-917f-acdb93885156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4cf64c-ca3d-4504-917f-acdb93885156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec7c6931-3e2e-497e-89ac-9ff369a99a60', 'volume_name': 'volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f60f1b-b436-4993-a46e-2b3fb9ae4968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f60f1b-b436-4993-a46e-2b3fb9ae4968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5212a755-980e-4d92-b79a-0a0b0f9f95e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:30 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Volume ec7c6931-3e2e-497e-89ac-9ff369a99a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60', 'volume_size': 1} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1408529327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7c6931-3e2e-497e-89ac-9ff369a99a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc412bf921ed437295b0e3fc6f2b8df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:30Z,use_quota=True,user_id='ad66161a7dad4ad6be5a9a932989519e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Creating volume ec7c6931-3e2e-497e-89ac-9ff369a99a60 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:44:30 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:30 devstack sudo[116570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 1073741824 Aug 13 09:44:30 devstack sudo[116570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-15e14642-b420-4d58-80bd-1a1523928ed5-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-15e14642-b420-4d58-80bd-1a1523928ed5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-1129f219-fd37-4bc1-bf98-b842af088be7" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-1129f219-fd37-4bc1-bf98-b842af088be7" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-15e14642-b420-4d58-80bd-1a1523928ed5" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-15e14642-b420-4d58-80bd-1a1523928ed5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Deleting offline snapshot 15e14642-b420-4d58-80bd-1a1523928ed5 of volume 1129f219-fd37-4bc1-bf98-b842af088be7 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] snapshot_file for this snap is: volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f71a5ca-3113-42d1-b1f5-8c842512e983]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:30 devstack sudo[116575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5 Aug 13 09:44:30 devstack sudo[116575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:30 devstack sudo[116570]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:30 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 1073741824" returned: 0 in 0.509s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:31 devstack sudo[116578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 Aug 13 09:44:31 devstack sudo[116578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:31 devstack sudo[116575]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5" returned: 0 in 0.423s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1129f219-fd37-4bc1-bf98-b842af088be7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:44:31 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b29d2c-1b5b-4c4f-af05-da387006ed8c]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:31 devstack sudo[116578]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60" returned: 0 in 0.277s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:31 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:44:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5212a755-980e-4d92-b79a-0a0b0f9f95e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbb9421-5899-4863-b934-e261ced32af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:31 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Volume volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 (ec7c6931-3e2e-497e-89ac-9ff369a99a60): created successfully Aug 13 09:44:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbb9421-5899-4863-b934-e261ced32af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:31 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Flow 'volume_create_manager' (263f5339-1932-4cba-b71b-b23113d9c811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:31 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-1e204a7e-1787-4942-b022-f167628ca713 tempest-ProjectReaderTests-708195512 None] Created volume successfully. Aug 13 09:44:31 devstack sudo[116585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7 Aug 13 09:44:31 devstack sudo[116585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:31 devstack sudo[116585]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7" returned: 0 in 0.396s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:31 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:31 devstack sudo[116590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5 Aug 13 09:44:31 devstack sudo[116590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:32 devstack sudo[116590]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5" returned: 0 in 0.341s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:32 devstack sudo[116595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5 Aug 13 09:44:32 devstack sudo[116595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:32 devstack sudo[116595]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7.15e14642-b420-4d58-80bd-1a1523928ed5" returned: 0 in 0.238s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-15e14642-b420-4d58-80bd-1a1523928ed5" released by "_delete_snapshot" :: held 1.508s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-1129f219-fd37-4bc1-bf98-b842af088be7" released by "delete_snapshot" :: held 1.531s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Created reservations ['581e1a50-fb44-49e9-81a6-534f59d54555', '121acbb5-f44a-48e6-9d22-ccc421e6f28c', '7ca729a2-8d0d-44bf-970c-97185ffab125', '2b3e2965-ce40-4fb8-9192-71fae208b931'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:32 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Delete snapshot completed successfully. Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-d8f488d4-9bd3-4485-8b87-817cbc07a9b1 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-15e14642-b420-4d58-80bd-1a1523928ed5-delete_snapshot" released by "delete_snapshot" :: held 1.678s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] Creating offline snapshot eb4fe445-3d3f-444b-bf7c-0e382b7bb977 of volume ec7c6931-3e2e-497e-89ac-9ff369a99a60 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fd3504-0b91-41b3-a47a-09ac48328067]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:32 devstack sudo[116598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 Aug 13 09:44:32 devstack sudo[116598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-1129f219-fd37-4bc1-bf98-b842af088be7-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-1129f219-fd37-4bc1-bf98-b842af088be7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-1129f219-fd37-4bc1-bf98-b842af088be7" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:32 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-1129f219-fd37-4bc1-bf98-b842af088be7" acquired by "delete_volume" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:33 devstack sudo[116598]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60" returned: 0 in 0.388s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9535dc-257e-47ba-8ba1-afbf537f32ea]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:33 devstack sudo[116603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977 1G Aug 13 09:44:33 devstack sudo[116603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:33 devstack sudo[116604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7 Aug 13 09:44:33 devstack sudo[116604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:33 devstack sudo[116604]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7" returned: 0 in 0.375s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:33 devstack sudo[116615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7 Aug 13 09:44:33 devstack sudo[116615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:33 devstack sudo[116603]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977 1G" returned: 0 in 0.455s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:33 devstack sudo[116617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977 Aug 13 09:44:33 devstack sudo[116617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:33 devstack sudo[116615]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-1129f219-fd37-4bc1-bf98-b842af088be7" returned: 0 in 0.261s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-1129f219-fd37-4bc1-bf98-b842af088be7" released by "delete_volume" :: held 0.704s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Created reservations ['ab4b76bd-b1c2-4054-a78c-be5e23db6972', 'd6ae67e5-e441-48a2-94bb-a9db1189d5af', 'c1f00b95-064f-4812-8d50-398993a84a11', 'b103158e-3130-4879-8827-c051b4251095'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:33 devstack sudo[116617]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977" returned: 0 in 0.319s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:33 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977 is being set with open permissions: ugo+rw Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:33 devstack sudo[116624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977 Aug 13 09:44:33 devstack sudo[116624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:33 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:33 devstack sudo[116626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:44:33 devstack sudo[116626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:34 devstack sudo[116624]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977" returned: 0 in 0.255s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:34 devstack sudo[116626]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.260s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:44:34 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Deleted volume successfully. Aug 13 09:44:34 devstack sudo[116630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.info Aug 13 09:44:34 devstack sudo[116630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-498d8834-d562-425a-9e6c-e411cc02d4f2 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-1129f219-fd37-4bc1-bf98-b842af088be7-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:34 devstack sudo[116630]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.info" returned: 0 in 0.292s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:34 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.info is being set with open permissions: ugo+rw Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:34 devstack sudo[116633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.info Aug 13 09:44:34 devstack sudo[116633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (7688d07f-27f4-45cf-895b-c415cd220bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b66a0e0-ad7e-4586-8887-25a56abbf9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b66a0e0-ad7e-4586-8887-25a56abbf9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2040763221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061a7d96-baec-4331-87e4-da8988eda625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:35Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f66f6c-623d-4056-907a-d4681a78a956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f66f6c-623d-4056-907a-d4681a78a956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:34 devstack sudo[116633]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d4d9c6-443b-4dec-ba93-b20197e9e8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d4d9c6-443b-4dec-ba93-b20197e9e8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '061a7d96-baec-4331-87e4-da8988eda625', 'volume_name': 'volume-061a7d96-baec-4331-87e4-da8988eda625', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ddb559-a0e5-440c-a69d-cdd4d2aa0cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ddb559-a0e5-440c-a69d-cdd4d2aa0cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e21c42-aa5d-4446-a264-9a50c7e4f647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:34 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Volume 061a7d96-baec-4331-87e4-da8988eda625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-061a7d96-baec-4331-87e4-da8988eda625', 'volume_size': 1} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.info" returned: 0 in 0.338s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.133s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2040763221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061a7d96-baec-4331-87e4-da8988eda625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:35Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Creating volume 061a7d96-baec-4331-87e4-da8988eda625 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:44:34 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:44:34 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:34 devstack sudo[116672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625 1073741824 Aug 13 09:44:34 devstack sudo[116672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:34 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-16b3ed12-509c-4a1b-a38e-e6fd7a2dd3fb tempest-ProjectReaderTests-708195512 None] Create snapshot completed successfully Aug 13 09:44:35 devstack sudo[116672]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625 1073741824" returned: 0 in 0.484s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:35 devstack sudo[116678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625 Aug 13 09:44:35 devstack sudo[116678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:35 devstack sudo[116678]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625" returned: 0 in 0.251s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e21c42-aa5d-4446-a264-9a50c7e4f647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061a7d96-baec-4331-87e4-da8988eda625', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950420ac-161d-42af-bd41-b9ba751f886e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:35 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Volume volume-061a7d96-baec-4331-87e4-da8988eda625 (061a7d96-baec-4331-87e4-da8988eda625): created successfully Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950420ac-161d-42af-bd41-b9ba751f886e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (7688d07f-27f4-45cf-895b-c415cd220bd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:35 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-6f48d7eb-2ea5-42d4-84bf-b9b6e2d5ab86 tempest-ProjectMemberTests-1073032951 None] Created volume successfully. Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-eb4fe445-3d3f-444b-bf7c-0e382b7bb977-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Lock "cinder-eb4fe445-3d3f-444b-bf7c-0e382b7bb977-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-quobyte-ec7c6931-3e2e-497e-89ac-9ff369a99a60" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-ec7c6931-3e2e-497e-89ac-9ff369a99a60" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-quobyte-eb4fe445-3d3f-444b-bf7c-0e382b7bb977" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-eb4fe445-3d3f-444b-bf7c-0e382b7bb977" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Deleting offline snapshot eb4fe445-3d3f-444b-bf7c-0e382b7bb977 of volume ec7c6931-3e2e-497e-89ac-9ff369a99a60 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] snapshot_file for this snap is: volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e4d00d-9cc5-4623-8b96-32687928097f]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:35 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:35 devstack sudo[116681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977 Aug 13 09:44:35 devstack sudo[116681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:36 devstack sudo[116681]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977" returned: 0 in 0.362s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:44:36 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e994c5-21f2-4d16-9a51-45ac049f5779]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:36 devstack sudo[116686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 Aug 13 09:44:36 devstack sudo[116686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:36 devstack sudo[116686]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60" returned: 0 in 0.390s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:36 devstack sudo[116691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977 Aug 13 09:44:36 devstack sudo[116691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:36 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] Creating offline snapshot 6e81f98a-3e6b-4e80-a78f-68d774fc50b3 of volume 061a7d96-baec-4331-87e4-da8988eda625 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:44:36 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f4dab7-67fb-458f-9a1b-e2142b024bc1]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:36 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:36 devstack sudo[116693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625 Aug 13 09:44:36 devstack sudo[116693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:37 devstack sudo[116691]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977" returned: 0 in 0.394s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:37 devstack sudo[116698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977 Aug 13 09:44:37 devstack sudo[116698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:37 devstack sudo[116693]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625" returned: 0 in 0.409s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:37 devstack sudo[116704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3 1G Aug 13 09:44:37 devstack sudo[116704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:37 devstack sudo[116698]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60.eb4fe445-3d3f-444b-bf7c-0e382b7bb977" returned: 0 in 0.274s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-eb4fe445-3d3f-444b-bf7c-0e382b7bb977" released by "_delete_snapshot" :: held 1.524s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-ec7c6931-3e2e-497e-89ac-9ff369a99a60" released by "delete_snapshot" :: held 1.550s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:37 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Created reservations ['25299ac0-295f-4805-a192-04b96b626d1e', '512259dd-60af-4335-ad48-b0fa83aabd4b', '652f9547-7d1a-49fa-a8fa-27674b2586b4', 'be56d156-94b2-450c-b6a4-b7786b3de11f'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:37 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Delete snapshot completed successfully. Aug 13 09:44:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-bfd21f58-b822-42b5-ae5f-1b0ea79a559f tempest-ProjectReaderTests-708195512 None] Lock "cinder-eb4fe445-3d3f-444b-bf7c-0e382b7bb977-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:37 devstack sudo[116704]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3 1G" returned: 0 in 0.440s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:37 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-061a7d96-baec-4331-87e4-da8988eda625 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:37 devstack sudo[116709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-061a7d96-baec-4331-87e4-da8988eda625 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3 Aug 13 09:44:37 devstack sudo[116709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-ec7c6931-3e2e-497e-89ac-9ff369a99a60-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Lock "cinder-ec7c6931-3e2e-497e-89ac-9ff369a99a60-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:37 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Acquiring lock "cinder-quobyte-ec7c6931-3e2e-497e-89ac-9ff369a99a60" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-ec7c6931-3e2e-497e-89ac-9ff369a99a60" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caae470-1ac3-4c28-beeb-bb117d84f460]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:38 devstack sudo[116709]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-061a7d96-baec-4331-87e4-da8988eda625 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3" returned: 0 in 0.372s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:38 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3 is being set with open permissions: ugo+rw Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:38 devstack sudo[116715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3 Aug 13 09:44:38 devstack sudo[116715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:38 devstack sudo[116714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 Aug 13 09:44:38 devstack sudo[116714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:38 devstack sudo[116715]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3" returned: 0 in 0.291s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:38 devstack sudo[116721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.info Aug 13 09:44:38 devstack sudo[116721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:38 devstack sudo[116714]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60" returned: 0 in 0.416s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:38 devstack sudo[116724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60 Aug 13 09:44:38 devstack sudo[116724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:38 devstack sudo[116721]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.info" returned: 0 in 0.318s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:38 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.info is being set with open permissions: ugo+rw Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:38 devstack sudo[116733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.info Aug 13 09:44:38 devstack sudo[116733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:38 devstack sudo[116724]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-ec7c6931-3e2e-497e-89ac-9ff369a99a60" returned: 0 in 0.298s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Lock "cinder-quobyte-ec7c6931-3e2e-497e-89ac-9ff369a99a60" released by "delete_volume" :: held 0.784s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Created reservations ['632002eb-acb3-4776-a625-bef6c4715e0d', '66537d31-9119-41be-8b85-6e7833e4e508', '459064d8-98a2-45db-b490-e2101eed059c', '94336956-cfc0-431a-8bda-92c5d0fac698'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:38 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:38 devstack sudo[116736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:44:38 devstack sudo[116736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:39 devstack sudo[116733]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.info" returned: 0 in 0.306s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:39 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-71bd56a6-ba64-4a31-9c48-8f418e5ff697 tempest-ProjectMemberTests-1073032951 None] Create snapshot completed successfully Aug 13 09:44:39 devstack sudo[116736]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:39 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.284s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:39 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:44:39 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Deleted volume successfully. Aug 13 09:44:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-514b8c1b-bf61-420e-96db-1d7ab510a451 tempest-ProjectReaderTests-708195512 None] Lock "cinder-ec7c6931-3e2e-497e-89ac-9ff369a99a60-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-6e81f98a-3e6b-4e80-a78f-68d774fc50b3-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-6e81f98a-3e6b-4e80-a78f-68d774fc50b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:39 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-061a7d96-baec-4331-87e4-da8988eda625" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-061a7d96-baec-4331-87e4-da8988eda625" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-6e81f98a-3e6b-4e80-a78f-68d774fc50b3" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:40 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-6e81f98a-3e6b-4e80-a78f-68d774fc50b3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Deleting offline snapshot 6e81f98a-3e6b-4e80-a78f-68d774fc50b3 of volume 061a7d96-baec-4331-87e4-da8988eda625 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:44:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] snapshot_file for this snap is: volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:44:40 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebf7aea-445c-480f-9321-8511ad701232]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:40 devstack sudo[116740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3 Aug 13 09:44:40 devstack sudo[116740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:40 devstack sudo[116740]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3" returned: 0 in 0.421s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:40 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-061a7d96-baec-4331-87e4-da8988eda625(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:44:40 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b8619e-ad54-4c70-9ade-5abb287d37b2]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:40 devstack sudo[116746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625 Aug 13 09:44:40 devstack sudo[116746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:40 devstack sudo[116746]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625" returned: 0 in 0.431s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:40 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:40 devstack sudo[116751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3 Aug 13 09:44:40 devstack sudo[116751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:41 devstack sudo[116751]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3" returned: 0 in 0.355s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:41 devstack sudo[116756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3 Aug 13 09:44:41 devstack sudo[116756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:41 devstack sudo[116756]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:41 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625.6e81f98a-3e6b-4e80-a78f-68d774fc50b3" returned: 0 in 0.249s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-6e81f98a-3e6b-4e80-a78f-68d774fc50b3" released by "_delete_snapshot" :: held 1.566s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-061a7d96-baec-4331-87e4-da8988eda625" released by "delete_snapshot" :: held 1.593s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:41 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Created reservations ['f7651457-69a9-4b35-a92a-77c3537d5f1e', 'b310ef0a-aaf5-4dc6-85be-5f19b4d635b3', 'b27c0ad1-3d75-4bf9-b841-eb81d0c50d56', 'd49faf42-d30b-4770-a26e-e14000c74969'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:41 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Delete snapshot completed successfully. Aug 13 09:44:41 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-de78d7f7-04d4-4f94-982f-d1e5ee758646 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-6e81f98a-3e6b-4e80-a78f-68d774fc50b3-delete_snapshot" released by "delete_snapshot" :: held 1.742s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-061a7d96-baec-4331-87e4-da8988eda625-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Lock "cinder-061a7d96-baec-4331-87e4-da8988eda625-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-061a7d96-baec-4331-87e4-da8988eda625" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-061a7d96-baec-4331-87e4-da8988eda625" acquired by "delete_volume" :: waited 0.024s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:42 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa098f7-55f1-4782-a6c0-bfb763dda588]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:42 devstack sudo[116759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625 Aug 13 09:44:42 devstack sudo[116759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:42 devstack sudo[116759]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625" returned: 0 in 0.380s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:42 devstack sudo[116764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625 Aug 13 09:44:42 devstack sudo[116764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:42 devstack sudo[116764]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:42 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-061a7d96-baec-4331-87e4-da8988eda625" returned: 0 in 0.255s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:42 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-061a7d96-baec-4331-87e4-da8988eda625" released by "delete_volume" :: held 0.691s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:42 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Created reservations ['0cc18326-061b-4b00-a92a-0e530ff9bfa5', 'fb89c582-3665-4cf6-a87c-b375b0bd26fd', '0c908ac4-5113-4e45-8963-a15ecc4c2b10', 'ff724556-deec-4f7c-91d7-36692d81f363'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:43 devstack sudo[116767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:44:43 devstack sudo[116767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:43 devstack sudo[116769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:44:43 devstack sudo[116769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:43 devstack sudo[116767]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.272s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:44:43 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Deleted volume successfully. Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-01153005-f55d-4264-9b17-eb7a4fae392e tempest-ProjectMemberTests-1073032951 None] Lock "cinder-061a7d96-baec-4331-87e4-da8988eda625-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:43 devstack sudo[116769]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.288s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (c73bf3f1-f0ca-4582-b271-e00dfe8003f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2761fa8-8f1d-4968-aac7-a8b714da9b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2761fa8-8f1d-4968-aac7-a8b714da9b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-35140093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12aad954-b613-4422-9de6-78773cb5d209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:44Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134be614-b501-4e32-a546-b144acc6db10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134be614-b501-4e32-a546-b144acc6db10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7890d3-0412-4a8d-88c2-d80c439c857a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7890d3-0412-4a8d-88c2-d80c439c857a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12aad954-b613-4422-9de6-78773cb5d209', 'volume_name': 'volume-12aad954-b613-4422-9de6-78773cb5d209', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077e1131-cef1-46da-9e5f-1a17a129d5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077e1131-cef1-46da-9e5f-1a17a129d5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2bfaa59-e86e-4681-8430-2b3b60dab7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:43 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Volume 12aad954-b613-4422-9de6-78773cb5d209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12aad954-b613-4422-9de6-78773cb5d209', 'volume_size': 1} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-35140093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12aad954-b613-4422-9de6-78773cb5d209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:44Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Creating volume 12aad954-b613-4422-9de6-78773cb5d209 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:44:43 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:44:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:43 devstack sudo[116773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209 1073741824 Aug 13 09:44:43 devstack sudo[116773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:44 devstack sudo[116773]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209 1073741824" returned: 0 in 0.418s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:44 devstack sudo[116778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209 Aug 13 09:44:44 devstack sudo[116778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:44 devstack sudo[116778]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209" returned: 0 in 0.253s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:44:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2bfaa59-e86e-4681-8430-2b3b60dab7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12aad954-b613-4422-9de6-78773cb5d209', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a291468-6aef-405b-990d-fe809d133173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:44 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Volume volume-12aad954-b613-4422-9de6-78773cb5d209 (12aad954-b613-4422-9de6-78773cb5d209): created successfully Aug 13 09:44:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a291468-6aef-405b-990d-fe809d133173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:44 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (c73bf3f1-f0ca-4582-b271-e00dfe8003f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:44 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-cabe5076-fe36-46a3-bc8d-07e1236fe6b5 tempest-ProjectMemberTests-1073032951 None] Created volume successfully. Aug 13 09:44:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:44 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:44 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] Creating offline snapshot b470363f-a360-43de-aad9-df600bad122b of volume 12aad954-b613-4422-9de6-78773cb5d209 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:44:45 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c85d6c-963d-4cbb-a7ea-76639b94d7a8]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:45 devstack sudo[116781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209 Aug 13 09:44:45 devstack sudo[116781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:45 devstack sudo[116781]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209" returned: 0 in 0.343s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:45 devstack sudo[116786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b 1G Aug 13 09:44:45 devstack sudo[116786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:45 devstack sudo[116786]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b 1G" returned: 0 in 0.385s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:45 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12aad954-b613-4422-9de6-78773cb5d209 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:45 devstack sudo[116791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12aad954-b613-4422-9de6-78773cb5d209 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b Aug 13 09:44:45 devstack sudo[116791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:46 devstack sudo[116791]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12aad954-b613-4422-9de6-78773cb5d209 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b" returned: 0 in 0.299s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:46 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b is being set with open permissions: ugo+rw Aug 13 09:44:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:46 devstack sudo[116796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b Aug 13 09:44:46 devstack sudo[116796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:46 devstack sudo[116796]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b" returned: 0 in 0.246s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:46 devstack sudo[116799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.info Aug 13 09:44:46 devstack sudo[116799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:46 devstack sudo[116799]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.info" returned: 0 in 0.252s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:46 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.info is being set with open permissions: ugo+rw Aug 13 09:44:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:46 devstack sudo[116802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.info Aug 13 09:44:46 devstack sudo[116802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:46 devstack sudo[116802]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.info" returned: 0 in 0.253s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:46 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.864s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:46 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-9d3b1cef-ff53-469b-8667-5d2a77aa121b tempest-ProjectMemberTests-1073032951 None] Create snapshot completed successfully Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-b470363f-a360-43de-aad9-df600bad122b-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Lock "cinder-b470363f-a360-43de-aad9-df600bad122b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-12aad954-b613-4422-9de6-78773cb5d209" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-12aad954-b613-4422-9de6-78773cb5d209" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-b470363f-a360-43de-aad9-df600bad122b" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-b470363f-a360-43de-aad9-df600bad122b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Deleting offline snapshot b470363f-a360-43de-aad9-df600bad122b of volume 12aad954-b613-4422-9de6-78773cb5d209 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] snapshot_file for this snap is: volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f60f9cf-0ffa-4e94-80f5-8fd35923cac5]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:47 devstack sudo[116805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b Aug 13 09:44:47 devstack sudo[116805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:47 devstack sudo[116805]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b" returned: 0 in 0.360s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12aad954-b613-4422-9de6-78773cb5d209(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[78def988-81be-44f7-ac6f-97ea35942218]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:47 devstack sudo[116810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209 Aug 13 09:44:47 devstack sudo[116810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:47 devstack sudo[116810]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209" returned: 0 in 0.361s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:47 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:47 devstack sudo[116815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b Aug 13 09:44:47 devstack sudo[116815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:48 devstack sudo[116815]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b" returned: 0 in 0.334s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:48 devstack sudo[116820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b Aug 13 09:44:48 devstack sudo[116820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:48 devstack sudo[116820]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:48 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209.b470363f-a360-43de-aad9-df600bad122b" returned: 0 in 0.243s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-b470363f-a360-43de-aad9-df600bad122b" released by "_delete_snapshot" :: held 1.394s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-12aad954-b613-4422-9de6-78773cb5d209" released by "delete_snapshot" :: held 1.419s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:48 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Created reservations ['79a9be68-525f-4dd0-9471-a0a45a56c882', '8ca61ed5-b5e2-4541-b02f-05c458db91f8', '09e7baf7-0dc4-4704-b7fd-6e3db38a7d70', 'e8883daa-3fd7-4a92-9bfb-4140add8dd0d'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:48 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Delete snapshot completed successfully. Aug 13 09:44:48 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-75b01d7c-74eb-46d1-bfc2-2ff21bd0d5dc tempest-ProjectMemberTests-1073032951 None] Lock "cinder-b470363f-a360-43de-aad9-df600bad122b-delete_snapshot" released by "delete_snapshot" :: held 1.574s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-12aad954-b613-4422-9de6-78773cb5d209-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-12aad954-b613-4422-9de6-78773cb5d209-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-12aad954-b613-4422-9de6-78773cb5d209" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:49 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-12aad954-b613-4422-9de6-78773cb5d209" acquired by "delete_volume" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:49 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c7f045-74d6-491a-865d-f408f72a0e12]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:49 devstack sudo[116823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209 Aug 13 09:44:49 devstack sudo[116823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:49 devstack sudo[116823]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209" returned: 0 in 0.367s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:49 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:49 devstack sudo[116828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209 Aug 13 09:44:49 devstack sudo[116828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:50 devstack sudo[116828]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-12aad954-b613-4422-9de6-78773cb5d209" returned: 0 in 0.255s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-12aad954-b613-4422-9de6-78773cb5d209" released by "delete_volume" :: held 0.680s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Created reservations ['35fec76a-7d5e-4e0b-bd97-8efa3a1ff101', 'f4621df2-6855-487b-b773-81edd9c86444', '3385b699-f38e-4cf3-9bb5-c969b75c1141', '252594f7-98f1-4313-ac76-00fd78f739dd'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:50 devstack sudo[116831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:44:50 devstack sudo[116831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:50 devstack sudo[116831]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.248s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:44:50 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Deleted volume successfully. Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-af6cebb2-1581-414a-8fc3-955c1219c566 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-12aad954-b613-4422-9de6-78773cb5d209-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (c6d59e9f-1d99-44ec-a61c-c631efa28d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce644ad-2c54-4aa9-9301-ee117570bdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce644ad-2c54-4aa9-9301-ee117570bdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022262965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9000ea42-d869-4c52-bd4f-0f0c89924eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:51Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d00ddb-1bc6-4dcf-ba4e-5f7bc08e3479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d00ddb-1bc6-4dcf-ba4e-5f7bc08e3479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5129d169-f3df-4649-a15b-8639087921c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5129d169-f3df-4649-a15b-8639087921c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9000ea42-d869-4c52-bd4f-0f0c89924eb4', 'volume_name': 'volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:50 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d8d04c-02ee-4306-a9ef-78564e269b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d8d04c-02ee-4306-a9ef-78564e269b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5f4a3f-457f-46a3-8d39-2cb1dc0ece2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:51 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Volume 9000ea42-d869-4c52-bd4f-0f0c89924eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4', 'volume_size': 1} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-13T07:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022262965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9000ea42-d869-4c52-bd4f-0f0c89924eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47358e591d49be94833fed90cad75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-13T07:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-13T07:44:51Z,use_quota=True,user_id='aa367991254b4f00a62564c8e8790d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(398bb466-5a0f-46c5-87fe-4d61de5d7895),volume_type_id=398bb466-5a0f-46c5-87fe-4d61de5d7895)}" {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Creating volume 9000ea42-d869-4c52-bd4f-0f0c89924eb4 {{(pid=94670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Selected osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 as target Quobyte volume. {{(pid=94670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 13 09:44:51 devstack cinder-volume[94670]: INFO cinder.volume.drivers.remotefs [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] casted to osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4 Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 1073741824 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:51 devstack sudo[116835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 1073741824 Aug 13 09:44:51 devstack sudo[116835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:51 devstack sudo[116835]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 1073741824" returned: 0 in 0.404s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:51 devstack sudo[116840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 Aug 13 09:44:51 devstack sudo[116840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:51 devstack sudo[116840]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4" returned: 0 in 0.244s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'} {{(pid=94670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5f4a3f-457f-46a3-8d39-2cb1dc0ece2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4', 'volume_size': 1}' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ad9221-ece2-4e1d-a007-15e2370aabb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 13 09:44:51 devstack cinder-volume[94670]: INFO cinder.volume.flows.manager.create_volume [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Volume volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 (9000ea42-d869-4c52-bd4f-0f0c89924eb4): created successfully Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ad9221-ece2-4e1d-a007-15e2370aabb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94670) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 13 09:44:51 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Flow 'volume_create_manager' (c6d59e9f-1d99-44ec-a61c-c631efa28d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94670) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 13 09:44:51 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-74b114b7-257b-4d0d-878a-dec9a8b13b06 tempest-ProjectMemberTests-1073032951 None] Created volume successfully. Aug 13 09:44:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:52 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] Creating offline snapshot 061c647a-92fd-495b-b102-0dbc6a398804 of volume 9000ea42-d869-4c52-bd4f-0f0c89924eb4 {{(pid=94670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 13 09:44:52 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[854f20d3-1dac-4ffc-83ed-a129b0eec339]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:52 devstack sudo[116843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 Aug 13 09:44:52 devstack sudo[116843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:52 devstack sudo[116843]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4" returned: 0 in 0.357s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804 1G {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:52 devstack sudo[116848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804 1G Aug 13 09:44:52 devstack sudo[116848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:52 devstack sudo[116848]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804 1G" returned: 0 in 0.423s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:52 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:52 devstack sudo[116853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804 Aug 13 09:44:52 devstack sudo[116853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:53 devstack sudo[116853]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 -F qcow2 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804" returned: 0 in 0.285s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:53 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804 is being set with open permissions: ugo+rw Aug 13 09:44:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:53 devstack sudo[116858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804 Aug 13 09:44:53 devstack sudo[116858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:53 devstack sudo[116858]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804" returned: 0 in 0.236s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:53 devstack sudo[116861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.info Aug 13 09:44:53 devstack sudo[116861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:53 devstack sudo[116861]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.info" returned: 0 in 0.270s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:53 devstack cinder-volume[94670]: WARNING cinder.volume.drivers.remotefs [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.info is being set with open permissions: ugo+rw Aug 13 09:44:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.info {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:53 devstack sudo[116864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.info Aug 13 09:44:53 devstack sudo[116864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:53 devstack sudo[116864]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:53 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.info" returned: 0 in 0.243s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:54 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-17e3f71f-ee7d-431f-b9de-b9c1f0ab5802 tempest-ProjectMemberTests-1073032951 None] Create snapshot completed successfully Aug 13 09:44:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-061c647a-92fd-495b-b102-0dbc6a398804-delete_snapshot" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-061c647a-92fd-495b-b102-0dbc6a398804-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-9000ea42-d869-4c52-bd4f-0f0c89924eb4" by "delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-9000ea42-d869-4c52-bd4f-0f0c89924eb4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-061c647a-92fd-495b-b102-0dbc6a398804" by "_delete_snapshot" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:54 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-061c647a-92fd-495b-b102-0dbc6a398804" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Deleting offline snapshot 061c647a-92fd-495b-b102-0dbc6a398804 of volume 9000ea42-d869-4c52-bd4f-0f0c89924eb4 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 13 09:44:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] snapshot_file for this snap is: volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804 {{(pid=94670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 13 09:44:54 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[964d6b5e-890f-4e4c-941e-fe0726de2cc5]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:54 devstack sudo[116867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804 Aug 13 09:44:54 devstack sudo[116867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:54 devstack sudo[116867]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804" returned: 0 in 0.369s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:54 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.remotefs [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 13 09:44:54 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5295efc-d3ce-48ee-9d87-2a9e34bc4d04]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:54 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:54 devstack sudo[116872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 Aug 13 09:44:54 devstack sudo[116872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:55 devstack sudo[116872]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4" returned: 0 in 0.350s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:55 devstack sudo[116877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804 Aug 13 09:44:55 devstack sudo[116877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:55 devstack sudo[116877]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804" returned: 0 in 0.349s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:55 devstack sudo[116882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804 Aug 13 09:44:55 devstack sudo[116882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:55 devstack sudo[116882]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:55 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4.061c647a-92fd-495b-b102-0dbc6a398804" returned: 0 in 0.241s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:55 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-061c647a-92fd-495b-b102-0dbc6a398804" released by "_delete_snapshot" :: held 1.395s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:55 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-9000ea42-d869-4c52-bd4f-0f0c89924eb4" released by "delete_snapshot" :: held 1.418s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:55 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Created reservations ['eb933a06-f3ad-45d7-8bc8-b6c2c280a83a', '76f2d9e9-a78f-4bd9-aaee-a83588d54e50', '542662ad-2210-49a1-85c4-41cd80ccfe73', 'eede2323-6b78-40e2-8374-0f08c193c979'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:55 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Delete snapshot completed successfully. Aug 13 09:44:55 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-21d04b84-6a7a-47a0-9609-9143debb4682 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-061c647a-92fd-495b-b102-0dbc6a398804-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-9000ea42-d869-4c52-bd4f-0f0c89924eb4-delete_volume" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-9000ea42-d869-4c52-bd4f-0f0c89924eb4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "cinder-quobyte-9000ea42-d869-4c52-bd4f-0f0c89924eb4" by "delete_volume" {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 13 09:44:56 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-9000ea42-d869-4c52-bd4f-0f0c89924eb4" acquired by "delete_volume" :: waited 0.015s {{(pid=94670) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 13 09:44:56 devstack cinder-volume[94670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2017c745-b0c8-4d5e-a179-617d98e46bd5]: (4, 'qcow2') {{(pid=95669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 13 09:44:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:56 devstack sudo[116885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 Aug 13 09:44:56 devstack sudo[116885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:56 devstack sudo[116885]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4" returned: 0 in 0.369s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:56 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:57 devstack sudo[116890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4 Aug 13 09:44:57 devstack sudo[116890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:57 devstack sudo[116890]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64/volume-9000ea42-d869-4c52-bd4f-0f0c89924eb4" returned: 0 in 0.246s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-quobyte-9000ea42-d869-4c52-bd4f-0f0c89924eb4" released by "delete_volume" :: held 0.671s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:44:57 devstack cinder-volume[94670]: DEBUG cinder.quota [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Created reservations ['466fc5ba-c400-46e2-9aee-6933d7cf378a', '36d11083-c019-4a60-b24b-c4e588e5b66a', 'b96862f0-a8cc-40e5-83a2-334e77b908ba', '5ae4700b-354d-43bc-a12c-162bd592b758'] {{(pid=94670) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 13 09:44:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:44:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:44:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:44:57 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:44:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:44:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:44:57 devstack sudo[116893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:44:57 devstack sudo[116893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:44:57 devstack sudo[116893]: pam_unix(sudo:session): session closed for user root Aug 13 09:44:57 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.266s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:44:57 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:44:57 devstack cinder-volume[94670]: INFO cinder.volume.manager [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Deleted volume successfully. Aug 13 09:44:57 devstack cinder-volume[94670]: DEBUG cinder.coordination [None req-e2193f5b-1b63-4c37-80c5-c159f5b3ff69 tempest-ProjectMemberTests-1073032951 None] Lock "cinder-9000ea42-d869-4c52-bd4f-0f0c89924eb4-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=94670) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 13 09:45:07 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:DELETE=9,cinder:SELECT=79,cinder:INSERT=26,cinder:UPDATE=111 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:45:07 devstack cinder-volume[94670]: DEBUG dbcounter [-] [94670] Writing DB stats cinder:SELECT=79,cinder:INSERT=32,cinder:UPDATE=95,cinder:DELETE=7 {{(pid=94670) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 13 09:45:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:45:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 13 09:45:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 13 09:45:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4': None} {{(pid=94670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 13 09:45:43 devstack cinder-volume[94670]: DEBUG cinder.volume.drivers.quobyte [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c62fad58-5798-4885-8c91-c1a5dd231aa4'] {{(pid=94670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 13 09:45:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.lockutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94670) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 13 09:45:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 13 09:45:43 devstack sudo[117100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64 Aug 13 09:45:43 devstack sudo[117100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 13 09:45:43 devstack sudo[117100]: pam_unix(sudo:session): session closed for user root Aug 13 09:45:43 devstack cinder-volume[94670]: DEBUG oslo_concurrency.processutils [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1389a466577a83cc99cbbc06dae0bd64" returned: 0 in 0.255s {{(pid=94670) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 13 09:45:43 devstack cinder-volume[94670]: DEBUG cinder.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Notifying Schedulers of capabilities ... {{(pid=94670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 13 09:45:43 devstack cinder-volume[94670]: DEBUG oslo_service.periodic_task [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] Running periodic task VolumeManager._thread_info {{(pid=94670) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 13 09:45:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread count: 28 {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 13 09:45:43 devstack cinder-volume[94670]: DEBUG cinder.volume.manager [None req-4c9674db-d6d2-4d50-a995-bfd88fccec22 None None] thread info: [<_MainThread(MainThread, started 140717892870272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94670) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}